-- Logs begin at Wed 2022-08-17 19:15:30 UTC, end at Wed 2022-08-17 20:43:02 UTC. -- Aug 17 20:12:04.457160 dv-cinder-835384-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 20:12:04 2022] *** Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: nodename: dv-cinder-835384-19-iscsi Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: machine: x86_64 Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: clock source: unix Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: pcre jit disabled Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: detected number of CPU cores: 4 Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: current working directory: / Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: detected binary path: /usr/bin/uwsgi-core Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: your processes number limit is 47680 Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: your memory page size is 4096 bytes Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: detected max file descriptor number: 2048 Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: lock engine: pthread robust mutexes Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: thunder lock: enabled Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 20:12:04.469373 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 20:12:04.508317 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: Python main interpreter initialized at 0x55ab1ad0f9c0 Aug 17 20:12:04.508317 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: python threads support enabled Aug 17 20:12:04.508317 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: your server socket listen backlog is limited to 100 connections Aug 17 20:12:04.508317 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: your mercy for graceful operations on workers is 90 seconds Aug 17 20:12:04.508769 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 20:12:04.508769 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: *** Operational MODE: preforking *** Aug 17 20:12:04.509019 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: *** uWSGI is running in multiple interpreter mode *** Aug 17 20:12:04.509019 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: spawned uWSGI master process (pid: 106152) Aug 17 20:12:04.509237 dv-cinder-835384-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 20:12:04.509834 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: spawned uWSGI worker 1 (pid: 106153, cores: 1) Aug 17 20:12:04.510155 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: spawned uWSGI worker 2 (pid: 106154, cores: 1) Aug 17 20:12:04.510315 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 20:12:05.183523 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 20:12:05.184187 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 20:12:06.284332 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:12:06.284332 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: from cryptography.utils import int_from_bytes Aug 17 20:12:06.284976 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:12:06.284976 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: from cryptography.utils import int_from_bytes Aug 17 20:12:06.285413 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:12:06.285413 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: from cryptography.utils import int_from_bytes Aug 17 20:12:06.285856 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:12:06.285856 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: from cryptography.utils import int_from_bytes Aug 17 20:12:08.850740 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 20:12:08.851421 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 20:12:08.851522 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 20:12:08.851870 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 20:12:08.852134 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 20:12:08.852523 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.852882 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.853209 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.853529 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.853859 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.854200 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.854527 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.854937 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.855076 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 20:12:08.855813 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.855960 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 20:12:08.856049 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.856049 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.856207 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-19-iscsi {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.856358 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 20:12:08.856461 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.856746 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.856837 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 20:12:08.857073 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.857262 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 20:12:08.857366 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.857448 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.857681 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.857817 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.858003 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.858154 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.858303 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.858403 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.858737 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.858878 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.859044 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860090 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860207 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860282 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860352 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860428 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860498 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860561 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860629 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860699 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860768 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.860848 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.861005 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-19-iscsi {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.861126 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.861291 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.861429 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.861598 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.861761 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.861900 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.862071 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.862205 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.862485 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-19-iscsi {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.862604 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.862836 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.862928 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.863139 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.863461 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.863461 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.863700 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.863849 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.864207 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.864536 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.864862 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.865185 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.865498 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.865854 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.865999 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.866145 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.866338 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.866484 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.866672 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.866800 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.867022 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.867157 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.867409 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.867719 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.868039 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.868346 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.868650 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.868904 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.869208 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.869566 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.870273 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.870811 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.871178 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.871328 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.871328 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.871588 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.871738 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.871738 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.871994 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.872083 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.872307 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.872438 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.872616 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.872871 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.873019 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.873220 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.873527 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.873663 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-19-iscsi {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.873832 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.874133 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.874287 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.874425 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.874730 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.874936 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.875183 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.875325 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.875560 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.875906 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.876079 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.876222 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.876633 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.876768 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.876916 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.877074 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.877203 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.877378 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.877540 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.877716 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.877837 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.878038 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.878140 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.878377 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.878469 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.878741 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.878853 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.879054 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.879155 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.879365 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.879462 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.879676 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.879825 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.879991 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.880103 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.880303 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.880397 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.880610 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.880704 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.880863 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.880959 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.881205 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.881307 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.881517 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.881612 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.881843 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.881996 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.882147 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.882278 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.882456 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.882597 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.882789 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.882949 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.883097 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.883239 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.883387 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.883516 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.883646 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.883775 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.883964 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.884123 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.884269 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.884411 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.884545 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.884670 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.884828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.884966 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.885139 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.885305 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.886359 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.886493 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.886695 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.886858 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.886999 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.887145 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.887285 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.887420 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.887552 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.887690 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.887858 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.887990 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.888127 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.888278 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.888430 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.888585 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.888736 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.888873 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.889022 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.889219 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.889362 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.889516 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.889652 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.889792 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.889931 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.890126 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.890279 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.890420 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.890554 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.890754 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.890903 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.891060 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.891466 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.891619 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.891758 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.891978 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.892124 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.892273 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.892433 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.892581 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.892719 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.892878 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.893031 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.893180 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.893339 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.893479 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.893619 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.893619 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.893889 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.894139 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.894304 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.894454 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.894593 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.894593 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.894904 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.895059 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.895176 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.895320 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.895452 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.895583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.895705 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.895852 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896000 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896131 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896247 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896374 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896488 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896665 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896803 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.896988 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.897127 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.897327 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.897462 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.897632 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.897767 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.897935 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.898091 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.898220 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.898355 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.898523 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.898702 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.898959 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.899123 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.899273 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.899420 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.899567 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.899712 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.899850 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.899998 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.900138 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.900291 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.900450 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.900591 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.900744 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.900892 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.901117 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.901501 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.901658 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.901993 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.902129 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.902318 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.902489 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.902724 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.902853 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.902987 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.903118 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.903298 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.903457 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.903622 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.903770 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.903936 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.904067 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.904259 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.904409 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.904591 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.904734 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.904909 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.905049 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.905221 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.905358 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.905529 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.905663 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.905831 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.905970 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.906137 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.906296 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.906422 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.906559 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.906757 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.906883 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.907061 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.907198 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.907363 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.907495 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.907665 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.907864 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.908317 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.908495 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.908623 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.908776 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.908909 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.909137 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.909336 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.909541 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.909863 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.910010 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.910174 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.910434 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.910593 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.910852 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.911184 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:12:08.911341 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.911497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.911635 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.911825 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.911983 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.912125 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.912281 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.912431 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.912571 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.912729 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.912879 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.913023 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.913167 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.913340 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.913485 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.913639 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.913788 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.913939 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.914100 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.914231 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.914377 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.914519 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.914747 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.914883 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.915032 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.915171 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.915307 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.915533 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.915673 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.915846 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.915989 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.916187 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.916326 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.916497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.916661 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.917023 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.917170 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.917351 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.917611 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.917827 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.918013 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.918153 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.918447 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.918621 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.919202 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.919202 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.919426 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.919541 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.919658 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.919829 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.919959 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.920179 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.920316 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.920508 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.920619 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.920811 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.920904 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.921132 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.921219 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.921476 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.921576 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.921786 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.921886 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.922096 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.922241 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.922404 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.922501 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.922751 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.925279 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.925279 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.925615 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.925727 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.925849 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.925975 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926059 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926059 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926199 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926322 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926425 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926501 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926566 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926688 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926770 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926855 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.926960 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927072 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927160 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927238 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927315 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927406 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927485 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927563 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927649 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927727 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927818 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.927927 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928015 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928100 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928100 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928242 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928325 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928416 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928520 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928603 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928676 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928755 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928832 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.928923 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.929001 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.929078 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.929304 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.929412 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.929619 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.929705 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.929918 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.930002 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.930221 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.930304 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.930527 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.930621 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.930858 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.930943 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.931166 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.931250 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.931472 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.931562 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.931777 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.931884 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.932083 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.932182 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.932969 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.933203 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.933457 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.933598 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.933986 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.934096 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.934242 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.934329 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.934558 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.934666 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.934900 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.935000 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.935216 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.935308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.935522 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.935615 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.935837 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.936036 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.936194 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.936282 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.936502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.936593 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.936810 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.936905 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.937210 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.937329 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.937440 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.937524 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.937747 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.937833 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.938051 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.938135 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.938386 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.938478 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.938739 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.938829 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.939045 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.939130 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.939368 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.939501 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.939680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.939786 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.939988 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.940115 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.940329 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.940415 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.940642 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.940729 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.940954 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.941048 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.941255 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.941352 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.941553 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.941638 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.941857 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.941949 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.942158 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.942255 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.942458 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.942542 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.942865 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.942965 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.943147 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.943251 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.943448 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.943533 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.943754 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.943846 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.944059 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.944158 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.944357 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.944444 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.944658 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.944742 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.944962 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.945056 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.945294 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.945378 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.945592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.945683 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.945915 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.945999 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.946228 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.946314 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.946541 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.946701 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.946872 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.946960 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.947181 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.947286 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.947487 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.947571 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.947793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.947936 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.948710 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.949052 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.949172 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.949278 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.949376 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.949590 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.949689 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.949910 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.950003 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.950222 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.950315 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.950528 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.950611 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.950867 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.950952 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.951189 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.951273 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.951496 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.951657 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.951814 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.951906 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.952118 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.952206 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.952425 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.952516 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.952730 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.952814 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.953053 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.953138 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.953362 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.953453 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.953667 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.953762 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.953971 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.954054 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.954274 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.954406 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.954576 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.954760 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.954912 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.955005 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.955264 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.955360 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.955681 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.955781 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.956004 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.956102 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.956312 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.956403 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.956624 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.956716 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.956930 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.957019 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.957238 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.957391 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.957542 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.957640 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.957857 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.957942 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.958156 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.958246 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.958465 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.958552 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.958801 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.958889 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.959115 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.959201 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.959418 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.959533 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.959732 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.959846 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.960043 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.960143 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.960347 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.960444 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.960655 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.960763 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.960961 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.961068 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.961256 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.961358 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.961600 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.961693 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.961908 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.962185 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.962278 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.962513 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.962596 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.962853 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.962938 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.963155 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.963250 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.963516 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.963604 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.963885 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.963980 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.964218 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.964430 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.964545 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.964742 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.964894 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.965062 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.965204 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.965387 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.965519 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.965699 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.965827 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.966017 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.966135 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.966334 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.966469 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.966670 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.966773 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.966965 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.967059 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.967287 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.967380 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.967594 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.967679 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.967896 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.967989 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.968198 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.968283 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.968500 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.968583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.968800 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.968891 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.969116 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.969202 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.969422 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.969507 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.969734 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.969842 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.970038 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.970138 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.970343 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.970436 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.970685 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.970778 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.970997 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.971084 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.971301 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.971387 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.971617 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.971702 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.971936 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.972027 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.972229 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.972314 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.972534 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.972628 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.972839 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.972924 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.973144 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.973230 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.973448 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.973534 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.973762 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.973848 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.974066 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.974159 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.974369 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.974461 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.974698 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.974786 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.974999 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.975171 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.975305 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.975392 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.975611 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.975695 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.975938 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.976192 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.976287 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.976520 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.976605 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.976831 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.976915 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.977142 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.977238 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.977495 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.977647 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.977760 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.977861 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.978066 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.978152 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.978389 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.978475 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.978725 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.978830 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.979036 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.979169 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.979377 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.979464 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.979692 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.979913 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.980028 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.980303 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.980445 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.980612 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.980752 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.980920 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.981020 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.981236 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.981321 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.981544 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.981629 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.981849 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.981943 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.982154 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.982246 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.982467 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.982552 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.982795 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.982897 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.983099 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.983186 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.983414 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.983499 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.983712 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.983798 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.984020 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.984110 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.984316 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.984399 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.984625 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.984717 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.984933 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.985018 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.985229 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.985312 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.985530 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.985616 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.985830 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.985914 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.986156 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.986247 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.986456 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.986540 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.986787 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.986876 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.987095 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.987199 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.987404 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.987488 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.987709 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.987800 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.988017 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.988115 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.988320 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.988414 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.988619 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.988702 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.988919 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.989013 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.989218 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.989305 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.989521 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.989612 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.989821 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.989906 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.990120 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.990204 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.990428 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.990520 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.990758 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.990897 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.991064 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.991160 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.991366 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.991451 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.991667 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.991753 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.991973 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.992073 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.992273 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.992358 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.992584 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.992670 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.992890 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.992974 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.993190 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.993275 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.993488 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.993582 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.993792 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.993877 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.994094 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.994187 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.994397 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.994482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.995268 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.995431 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.995588 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.995718 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.995870 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.996176 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.996261 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.996498 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.996632 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.996812 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.996938 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.997125 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.997258 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.997445 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.997532 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.997768 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.997905 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.998092 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.998178 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.998397 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.998492 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.998734 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.998822 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.999037 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.999121 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.999338 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.999439 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.999643 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.999726 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:08.999942 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.000034 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.000241 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.000344 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.000545 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.000630 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.000855 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.000978 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.001165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.001263 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.001462 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.001548 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.001767 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.001850 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.002064 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.002158 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.002365 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.002450 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.002687 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.002776 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.002993 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.003087 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.003290 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.003384 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.003587 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.003671 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.003884 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.003970 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.004182 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.004266 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.004480 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.004564 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.004784 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.004877 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.005090 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.005226 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.005387 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.005540 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.005684 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.005852 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.005982 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.006159 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.006320 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.006470 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.006619 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.006804 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.006992 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.007124 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.007294 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.007439 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.007603 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.007747 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.007944 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.008164 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.008251 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.008477 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.008564 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.008790 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.008874 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.009099 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.009196 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.009404 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.009491 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.009713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.009809 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.010027 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.010121 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.010478 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.010573 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.010907 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.011062 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.011219 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.011432 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.011518 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.011749 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.011843 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.012202 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.012433 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.012525 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.012754 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.012839 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.013077 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.013171 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.013380 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.013466 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.013688 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.013840 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.014066 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.014159 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.014385 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.014470 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.014722 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.014821 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.015031 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.015124 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.015339 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.015431 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.015648 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.015776 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.015956 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.016063 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.016528 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.016617 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.016834 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.016918 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.017137 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.017231 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.017443 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.017531 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.017747 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.017832 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.018048 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.018133 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.018365 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.018450 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.018692 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.018781 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.018996 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.019082 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.019298 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.019384 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.019599 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.019731 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.019940 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.020042 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.020210 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.020331 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.020636 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.020729 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.020942 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.021028 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.021248 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.021332 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.021549 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.021644 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.021853 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.021946 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.022155 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.022238 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.022462 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.022555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.022794 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.022879 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.023097 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.023193 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.023406 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.023499 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.023716 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.023809 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.024026 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.024224 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.024330 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.024415 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.024633 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.024728 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.024955 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.025040 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.025257 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.025342 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.025596 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.025705 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.025875 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.026501 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.026760 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.026862 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.027089 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.027370 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.027459 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.027710 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.027795 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.028016 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.028117 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.028318 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.028402 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.028623 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.028736 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.028927 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.029049 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.029270 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.029357 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.029581 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.029751 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.029905 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.030059 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.030244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.030367 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.030577 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.030718 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.030916 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.031038 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.031251 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.031358 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.031584 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.031669 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.031908 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.032001 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.032229 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.032315 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.032552 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.032635 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.032856 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.032941 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.033161 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.033246 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.033470 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.033561 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.033770 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.033855 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.034072 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.034162 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.034377 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.034470 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.034711 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.034799 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.035016 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.035110 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.035321 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.035419 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.035625 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.035731 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.035947 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.036031 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.036253 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.036349 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.036575 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.036661 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.036885 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.036970 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.037191 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.037319 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.037498 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.037591 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.037794 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.037885 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.038095 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.038313 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.038402 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.038488 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.038721 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.038820 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.039028 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.039122 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.039331 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.039417 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.039635 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.039725 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.039935 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.040020 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.040232 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.040316 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.040546 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.040641 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.040845 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.040930 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.041159 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.041244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.041465 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.041581 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.041838 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.041968 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.042157 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.042473 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.042555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.042811 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.042901 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.043134 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.043381 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.043468 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.043711 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.043808 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.044024 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.044108 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.044326 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.044418 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.044636 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.044721 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.044949 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.045041 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.045262 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.045347 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.045574 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.045659 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.045886 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.045971 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.046190 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.046280 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.046498 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.046595 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.046854 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.046945 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.047170 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.047253 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.047484 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.047570 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.047802 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.047887 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.048102 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.048200 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.048401 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.048498 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.048706 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.048791 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.049005 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.049103 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.049305 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.049397 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.049602 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.049694 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.049904 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.050033 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.050199 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.050292 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.050498 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.050593 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.050819 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.050914 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.051135 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.051221 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.051436 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.051578 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.051743 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.051874 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.052045 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.052130 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.052343 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.052428 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.052642 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.052738 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.052938 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.053023 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.053271 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.053363 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.053568 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.053659 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.053888 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.053973 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.054190 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.054287 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.054510 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.054596 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.054848 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.054945 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.055157 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.055251 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.055467 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.055684 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.055769 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.056007 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.056101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.056346 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.056431 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.056654 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.056745 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.056959 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.057121 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.057819 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.057998 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.058332 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.058416 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.058692 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.058799 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.059006 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.059318 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.059402 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.059701 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.059836 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.059986 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.060071 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.060249 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.060336 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.060558 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.060653 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.060867 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.060952 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.061174 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.061265 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.061479 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.061576 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.061787 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.061871 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.062093 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.062324 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.062411 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.062711 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.062811 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.063035 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.063121 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.063352 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.063443 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.063677 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.063761 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.063990 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.064080 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.064297 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.064390 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.064610 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.064700 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.064921 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.065004 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.065231 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.065323 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.065550 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.065635 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.065853 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.065937 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.066162 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.066246 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.066468 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.066551 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.066802 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.066902 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.067110 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.067196 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.067417 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.067508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.067721 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.067805 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.068027 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.068116 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.068329 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.068412 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.068632 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.068734 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.068938 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.069023 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.069244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.069328 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.069559 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.069652 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.069869 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.069953 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.070181 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.070266 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.070487 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.070580 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.070818 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.070903 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.071126 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.071211 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.071430 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.071642 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.071774 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.071952 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.072038 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.072279 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.072372 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.072599 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.072685 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.072968 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.073058 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.073278 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.073595 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.073706 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.073941 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.074025 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.074294 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.074386 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.074606 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.074772 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.074931 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.075024 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.075241 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.075327 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.075549 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.075643 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.075853 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.075938 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.076173 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.076266 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.076479 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.076564 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.076779 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.077024 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.077109 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.077360 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.077453 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.077683 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.077907 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.078039 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.078253 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.078348 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.078564 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.078701 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.078912 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.078997 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.079233 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.079335 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.079547 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.079633 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.079851 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.079936 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.080161 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.080252 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.080460 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.080544 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.080761 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.080846 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.081070 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.081154 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.081377 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.081460 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.081680 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.081765 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.081982 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.082068 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.082291 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.082375 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.082596 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.082720 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.082928 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.083014 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.083239 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.083324 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.083538 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.083633 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.083848 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.083933 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.084149 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.084232 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.084457 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.084555 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.084759 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.084845 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.085069 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.085160 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.085371 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.085468 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.085673 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.085766 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.085977 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.086063 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.086276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.086362 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.086583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.086696 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.086909 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.087002 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.087212 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.087300 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.087511 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.087603 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.087816 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.087909 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.088159 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.088244 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.089121 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.089259 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.089438 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.089763 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.089875 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.090086 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.090267 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.090403 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.091330 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.091485 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.091576 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.091655 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.091734 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.091817 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.091941 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092094 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092184 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092270 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092349 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092426 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092618 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092712 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.092949 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.093036 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.093276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.093360 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.093583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.093820 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.093913 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.094152 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.094238 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.094469 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.094562 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.094828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.094914 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.095143 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.095228 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.095448 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.095547 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.095755 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.095846 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.096067 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.096154 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.096374 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.096509 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.096680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.096766 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.096985 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.097078 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.097289 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.097377 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.097592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.097676 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.097891 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.097982 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.098195 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.098326 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.098496 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.098581 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.098823 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.098940 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.099125 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.099210 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.099429 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.099522 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.099733 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.099827 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.100039 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.100123 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.100344 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.100429 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.100646 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.100739 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.100946 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.101038 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.101250 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.101335 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.101577 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.101671 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.101890 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.101975 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.102200 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.102293 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.102510 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.102597 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.102846 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.102932 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.103150 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.103235 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.103453 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.103540 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.103759 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.103844 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.104102 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.104731 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.104946 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.105262 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.105380 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.105594 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.105893 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.106000 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.106185 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.106272 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.106503 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.106618 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.106844 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.106943 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.107156 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.107248 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.107470 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.107556 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.107803 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.107899 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.108133 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.108220 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.108444 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.108529 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.108771 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.108869 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.109091 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.109176 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.109416 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.109552 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.109739 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.109842 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.110054 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.110141 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.110386 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.110472 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.110724 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.110817 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.111040 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.111127 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.111352 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.111437 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.111651 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.111737 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.111958 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.112044 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.112273 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.112366 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.112575 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.112660 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.112882 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.112967 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.113182 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.113277 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.113487 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.113573 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.113786 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.113871 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.114088 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.114182 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.114389 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.114474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.114710 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.114797 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.115022 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.115290 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.115390 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.115470 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.115606 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.115692 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.115904 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.116045 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.116201 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.116377 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.116499 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.116697 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.116792 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.117013 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.117099 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.117323 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.117417 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.117568 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 20:12:09.117738 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.117937 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.118235 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.118532 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.118885 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.119211 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.119520 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.120016 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.120536 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.120969 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.121281 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.121601 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.121920 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.122237 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.122545 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.122951 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.123208 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.123514 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.123820 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.124126 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.124433 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.124738 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.125069 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.125391 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.125698 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.126035 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.126329 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.126738 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.127058 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.127364 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.127691 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.127996 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.128300 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.128650 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.128904 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.129208 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.129519 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.129825 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.130131 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.130439 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.130776 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.131105 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.131424 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.131729 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.132051 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.132368 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.132708 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.133017 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.133357 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.133680 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.133990 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.134298 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.134599 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:12:09.134869 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 20:12:09.274904 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Registered counter for database nova_api Aug 17 20:12:09.294099 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Registered counter for database nova_api Aug 17 20:12:09.298549 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.308347 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.327411 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.335089 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.368403 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.context [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb200869-c0cd-497b-a077-1c09d01e21d1(cell1) {{(pid=106154) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 20:12:09.372698 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:09.373184 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:09.374783 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:09.375530 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:09.375982 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:09.377964 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:09.379983 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Registered counter for database nova_cell0 Aug 17 20:12:09.386066 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Registered counter for database nova_cell1 Aug 17 20:12:09.393776 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.396266 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.396386 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.context [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb200869-c0cd-497b-a077-1c09d01e21d1(cell1) {{(pid=106153) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 20:12:09.400332 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:09.400806 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:09.402021 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.403813 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:09.404566 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:12:09.404787 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.405008 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:12:09.407058 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_concurrency.lockutils [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:12:09.409139 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Registered counter for database nova_cell0 Aug 17 20:12:09.414876 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Registered counter for database nova_cell1 Aug 17 20:12:09.422904 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.424992 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.431833 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.433719 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.552457 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO dbcounter [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Registered counter for database nova_cell0 Aug 17 20:12:09.559282 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_db.sqlalchemy.engines [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.563928 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writer thread running {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.583480 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO dbcounter [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Registered counter for database nova_cell0 Aug 17 20:12:09.592777 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG oslo_db.sqlalchemy.engines [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:12:09.597101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writer thread running {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:12:09.994043 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:12:10.002354 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:12:10.028902 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:12:10.036317 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:12:10.348822 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:12:10.356089 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: WARNING keystonemiddleware.auth_token [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:12:10.361531 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab1ad0f9c0 pid: 106154 (default app) Aug 17 20:12:10.363734 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:12:10.364943 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001830 Aug 17 20:12:10.365706 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Wed Aug 17 20:12:10 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:12:10.399350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:12:10.406801 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: WARNING keystonemiddleware.auth_token [None req-96495e27-192a-4024-8cef-73098afe84b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:12:10.412194 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55ab1ad0f9c0 pid: 106153 (default app) Aug 17 20:13:36.211258 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:36.212805 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002788 Aug 17 20:13:36.213412 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:13:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:36.226388 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=3 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:36.227697 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell0:SELECT=3 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:36.228708 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell1:SELECT=3 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:36.229653 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:37.214579 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-67caccea-3ac8-48b1-9d8b-5784001b41b2 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:37.260818 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-67caccea-3ac8-48b1-9d8b-5784001b41b2 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.039557 Aug 17 20:13:37.263264 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Aug 17 20:13:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:13:39.804938 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:39.806363 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-e5410865-8574-4881-81f6-775b4d95fe59 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Aug 17 20:13:39.810648 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:13:39 2022] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:40.318153 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-f6144b1c-98b2-4894-82e1-2bd8b56737f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "ram": 256, "name": "cirros256", "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "os-flavor-access:is_public": true}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:40.340146 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:13:40.340146 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: warnings.warn(msg) Aug 17 20:13:40.460438 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-f6144b1c-98b2-4894-82e1-2bd8b56737f4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.646287 Aug 17 20:13:40.464097 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:13:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 651 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:13:40.682530 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f19f990b-efc8-4c3d-887b-75830c2b650f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:40.688143 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:13:40.688143 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: warnings.warn(msg) Aug 17 20:13:40.690994 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:SELECT=3 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:40.691844 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell1:SELECT=3 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:40.693084 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell0:SELECT=3 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:40.694380 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:13:40.846306 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f19f990b-efc8-4c3d-887b-75830c2b650f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.376703 Aug 17 20:13:40.848183 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Aug 17 20:13:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:13:43.486416 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-f6144b1c-98b2-4894-82e1-2bd8b56737f4 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:43.489121 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-f6144b1c-98b2-4894-82e1-2bd8b56737f4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003488 Aug 17 20:13:43.489913 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:13:43 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:44.566943 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-db2d0e71-0454-4fb0-b0a6-457baba39100 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "swap": 0, "name": "ds512M", "ram": 512, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:44.593952 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:13:44.593952 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: warnings.warn(msg) Aug 17 20:13:44.706379 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-db2d0e71-0454-4fb0-b0a6-457baba39100 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.205241 Aug 17 20:13:44.707587 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:13:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:13:44.721351 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-a6f95a4e-241d-485b-8126-dd44ce89a141 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:44.724426 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:13:44.724426 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: warnings.warn(msg) Aug 17 20:13:44.851037 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-a6f95a4e-241d-485b-8126-dd44ce89a141 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.132985 Aug 17 20:13:44.853035 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Aug 17 20:13:44 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:13:47.743004 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-db2d0e71-0454-4fb0-b0a6-457baba39100 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:47.744018 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-db2d0e71-0454-4fb0-b0a6-457baba39100 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Aug 17 20:13:47.746992 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:13:47 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:48.209209 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-07631d7e-10f8-4bf6-b445-bd36fed7c6ec admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "os-flavor-access:is_public": true, "id": "d2", "swap": 0, "vcpus": 1, "name": "ds1G"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:48.379586 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-07631d7e-10f8-4bf6-b445-bd36fed7c6ec admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.628393 Aug 17 20:13:48.380332 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:13:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 630 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:13:48.393985 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-6010b007-efbb-4c44-ab5b-037d9bc6b8a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:48.487687 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-6010b007-efbb-4c44-ab5b-037d9bc6b8a9 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098387 Aug 17 20:13:48.488298 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Aug 17 20:13:48 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:13:50.946860 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-07631d7e-10f8-4bf6-b445-bd36fed7c6ec admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:50.947797 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-07631d7e-10f8-4bf6-b445-bd36fed7c6ec admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 17 20:13:50.948199 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:13:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:13:51.685874 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-3e3710ea-9483-4beb-b05b-c474a07d791d admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "disk": 10, "os-flavor-access:is_public": true, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "rxtx_factor": 1.0, "ram": 2048}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:51.777794 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-3e3710ea-9483-4beb-b05b-c474a07d791d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.822070 Aug 17 20:13:51.778601 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:13:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:13:51.793151 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-2814b3a8-cbd1-49a3-910a-feff4759c71e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:51.894471 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-2814b3a8-cbd1-49a3-910a-feff4759c71e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105365 Aug 17 20:13:51.895304 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Aug 17 20:13:51 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:13:54.487509 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-3e3710ea-9483-4beb-b05b-c474a07d791d admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:54.489087 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-3e3710ea-9483-4beb-b05b-c474a07d791d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002266 Aug 17 20:13:54.490108 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:13:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:55.172394 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-728327ba-a29c-454e-9598-80a1ec2f7c84 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 4, "name": "ds4G"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:55.277769 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-728327ba-a29c-454e-9598-80a1ec2f7c84 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.779240 Aug 17 20:13:55.282208 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:13:54 2022] POST /compute/v2.1/flavors => generated 404 bytes in 784 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 20:13:55.293105 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-eb533199-0bf8-4fb2-97c0-ea3077fad5ae admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:13:55.407037 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-eb533199-0bf8-4fb2-97c0-ea3077fad5ae admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.117802 Aug 17 20:13:55.418156 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1336 bytes} [Wed Aug 17 20:13:55 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:13:57.920502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-728327ba-a29c-454e-9598-80a1ec2f7c84 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:57.921555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-728327ba-a29c-454e-9598-80a1ec2f7c84 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001519 Aug 17 20:13:57.921970 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:13:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:13:58.484521 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-80aa154b-2a24-454e-be8f-3376294ce0dc admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:13:58.511797 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-80aa154b-2a24-454e-be8f-3376294ce0dc admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.583422 Aug 17 20:13:58.512703 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Aug 17 20:13:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:14:02.249393 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-728327ba-a29c-454e-9598-80a1ec2f7c84 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:02.251135 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-728327ba-a29c-454e-9598-80a1ec2f7c84 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002285 Aug 17 20:14:02.251849 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:14:02 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:02.741388 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-00385c71-c5c7-4d07-ad2d-a198399d321b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "1", "swap": 0, "vcpus": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "disk": 1, "os-flavor-access:is_public": true}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:02.842118 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-00385c71-c5c7-4d07-ad2d-a198399d321b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.582258 Aug 17 20:14:02.842697 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:14:02 2022] POST /compute/v2.1/flavors => generated 402 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:14:02.855656 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-cdf96015-92c9-4de8-9587-4658da8624c0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:02.949466 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-cdf96015-92c9-4de8-9587-4658da8624c0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098207 Aug 17 20:14:02.950043 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Aug 17 20:14:02 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:14:05.393552 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-00385c71-c5c7-4d07-ad2d-a198399d321b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:05.394823 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-00385c71-c5c7-4d07-ad2d-a198399d321b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Aug 17 20:14:05.395103 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:05.875630 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-045e5da7-10d0-4bd7-bcc1-a3d0aec76635 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "ram": 2048, "vcpus": 1}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:05.974839 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-045e5da7-10d0-4bd7-bcc1-a3d0aec76635 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.572914 Aug 17 20:14:05.975636 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:14:05 2022] POST /compute/v2.1/flavors => generated 405 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 20:14:05.988190 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-a774d46e-c158-449e-95d8-03671c2859c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:06.103194 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-a774d46e-c158-449e-95d8-03671c2859c4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118708 Aug 17 20:14:06.103935 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Aug 17 20:14:05 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:14:08.995663 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-045e5da7-10d0-4bd7-bcc1-a3d0aec76635 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:09.000839 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-045e5da7-10d0-4bd7-bcc1-a3d0aec76635 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005600 Aug 17 20:14:09.001795 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:14:08 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:09.763482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-143eccbd-5246-41e9-9ba0-fd6c09719c27 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "id": "3", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "ram": 4096, "vcpus": 2}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:09.953173 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-143eccbd-5246-41e9-9ba0-fd6c09719c27 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.944410 Aug 17 20:14:09.962772 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:14:09 2022] POST /compute/v2.1/flavors => generated 406 bytes in 946 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 20:14:09.972812 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-fce51eee-33b0-48bb-83e9-74e70cea5809 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:09.996351 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:10.083325 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-fce51eee-33b0-48bb-83e9-74e70cea5809 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118129 Aug 17 20:14:10.084089 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Aug 17 20:14:09 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:14:12.617564 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-143eccbd-5246-41e9-9ba0-fd6c09719c27 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:12.618589 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-143eccbd-5246-41e9-9ba0-fd6c09719c27 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 17 20:14:12.619030 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:14:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:14:13.155193 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-2f693290-50bf-4d52-b28a-decd113a4082 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "id": "4", "os-flavor-access:is_public": true, "name": "m1.large", "swap": 0, "disk": 80}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:13.238875 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-2f693290-50bf-4d52-b28a-decd113a4082 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.608969 Aug 17 20:14:13.242678 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:14:12 2022] POST /compute/v2.1/flavors => generated 405 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 20:14:13.253234 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-c32011aa-3326-4e16-b734-ff431b8f3fdd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:13.383535 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-c32011aa-3326-4e16-b734-ff431b8f3fdd admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.133946 Aug 17 20:14:13.384658 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Aug 17 20:14:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:14:16.171041 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-2f693290-50bf-4d52-b28a-decd113a4082 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:16.172039 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-2f693290-50bf-4d52-b28a-decd113a4082 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Aug 17 20:14:16.172727 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:14:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:16.700276 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-09e6ae0a-33e2-4ee8-8b75-cb03c4ab723f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "id": "5", "ram": 16384, "disk": 160}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:16.707983 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:16.810071 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-09e6ae0a-33e2-4ee8-8b75-cb03c4ab723f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.626081 Aug 17 20:14:16.810538 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1283 bytes} [Wed Aug 17 20:14:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:14:16.836953 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-b3d1deaf-0c49-4afc-ac5c-6944b597fcf5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:16.927554 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-b3d1deaf-0c49-4afc-ac5c-6944b597fcf5 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098748 Aug 17 20:14:16.931068 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1333 bytes} [Wed Aug 17 20:14:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:14:33.912757 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-09e6ae0a-33e2-4ee8-8b75-cb03c4ab723f admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:33.913776 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-09e6ae0a-33e2-4ee8-8b75-cb03c4ab723f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Aug 17 20:14:33.914190 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:14:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:33.921470 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:14:34.350858 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-27d77b67-3866-4cab-842b-2ba619e10fdb admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:34.370050 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-27d77b67-3866-4cab-842b-2ba619e10fdb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.449307 Aug 17 20:14:34.370614 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Aug 17 20:14:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:14:35.481151 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-09e6ae0a-33e2-4ee8-8b75-cb03c4ab723f admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:35.482163 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-09e6ae0a-33e2-4ee8-8b75-cb03c4ab723f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Aug 17 20:14:35.482563 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:36.031564 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-39c1f4f8-f9e1-4aed-9711-79bccd7613b4 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:36.037485 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.wsgi [None req-39c1f4f8-f9e1-4aed-9711-79bccd7613b4 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-39c1f4f8-f9e1-4aed-9711-79bccd7613b4 admin admin] Request method failure captured: Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Accept: application/json Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Accept-Encoding: gzip, deflate Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Connection: keep-alive Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Content-Length: 0 Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Host: 10.222.0.64 Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Openstack-Api-Version: compute 2.90 Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Openstack-System-Scope: None Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: User-Agent: python-novaclient Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Auth-Token: gAAAAABi_Uwr_3diDa3w75-WP8fsbE1Gtmwyhk4IlA7bP5gi-UmrwDbf_KD-Ri_UibOcO1RlQ8SIkMyM4-5bf4eYhdTHDEEP6RGd3BFOARY-3D7fA7zbNdY985Ajk3yIsztGDi6N7Q8oGx5mxFqPyYSPS-m_4M4O6vzS97fIHNh7yyLEhQTWYRE Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Domain-Id: None Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Domain-Name: None Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Identity-Status: Confirmed Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Is-Admin-Project: True Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Domain-Id: default Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Domain-Name: Default Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Name: admin Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Role: member,admin,reader Aug 17 20:14:36.040793 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Roles: member,admin,reader Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant: admin Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant-Name: admin Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User: admin Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Domain-Id: default Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Domain-Name: Default Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Id: 55cfb5b1f26a4ec19b12e7ce5108fd60 Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Name: admin Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: method: > Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: exception: Flavor 42 could not be found. Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: action_args: {'id': '42'} Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:14:36.042283 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:36.043276 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.044592 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-39c1f4f8-f9e1-4aed-9711-79bccd7613b4 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:14:36.045952 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-39c1f4f8-f9e1-4aed-9711-79bccd7613b4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.421932 Aug 17 20:14:36.045952 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 17 20:14:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:36.053434 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-601c4a70-fed4-40b0-af67-39909c6715a5 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:36.076745 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-601c4a70-fed4-40b0-af67-39909c6715a5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.028081 Aug 17 20:14:36.078185 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 17 20:14:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:14:36.087774 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-f5b53135-ed44-43ce-875f-c421ca8c3f88 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:36.113714 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-f5b53135-ed44-43ce-875f-c421ca8c3f88 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029754 Aug 17 20:14:36.114850 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 17 20:14:36 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:14:36.129196 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f938e9ec-d189-4ee6-bf92-0571d4673f2b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:36.137008 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.wsgi [None req-f938e9ec-d189-4ee6-bf92-0571d4673f2b admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f938e9ec-d189-4ee6-bf92-0571d4673f2b admin admin] Request method failure captured: Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Accept: application/json Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Accept-Encoding: gzip, deflate Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Connection: keep-alive Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Content-Length: 0 Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Host: 10.222.0.64 Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Openstack-Api-Version: compute 2.90 Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Openstack-System-Scope: None Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: User-Agent: python-novaclient Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Auth-Token: gAAAAABi_Uwr_3diDa3w75-WP8fsbE1Gtmwyhk4IlA7bP5gi-UmrwDbf_KD-Ri_UibOcO1RlQ8SIkMyM4-5bf4eYhdTHDEEP6RGd3BFOARY-3D7fA7zbNdY985Ajk3yIsztGDi6N7Q8oGx5mxFqPyYSPS-m_4M4O6vzS97fIHNh7yyLEhQTWYRE Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Domain-Id: None Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Domain-Name: None Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Identity-Status: Confirmed Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Is-Admin-Project: True Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Domain-Id: default Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Domain-Name: Default Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Name: admin Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Role: member,admin,reader Aug 17 20:14:36.140680 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Roles: member,admin,reader Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant: admin Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant-Name: admin Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User: admin Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Domain-Id: default Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Domain-Name: Default Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Id: 55cfb5b1f26a4ec19b12e7ce5108fd60 Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Name: admin Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: method: > Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: exception: Flavor 42 could not be found. Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: action_args: {'id': '42'} Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:14:36.142244 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:36.143197 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:36.144583 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-f938e9ec-d189-4ee6-bf92-0571d4673f2b admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:14:36.146667 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-f938e9ec-d189-4ee6-bf92-0571d4673f2b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.020429 Aug 17 20:14:36.146667 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 17 20:14:36 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 22 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:37.180691 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-f5b53135-ed44-43ce-875f-c421ca8c3f88 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:37.181701 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-f5b53135-ed44-43ce-875f-c421ca8c3f88 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 17 20:14:37.182095 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:37.735784 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-9dc98167-0cce-48b9-8f9c-f2266a170239 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:37.741810 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.wsgi [None req-9dc98167-0cce-48b9-8f9c-f2266a170239 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-9dc98167-0cce-48b9-8f9c-f2266a170239 admin admin] Request method failure captured: Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Accept: application/json Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Accept-Encoding: gzip, deflate Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Connection: keep-alive Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Content-Length: 0 Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Host: 10.222.0.64 Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Openstack-Api-Version: compute 2.90 Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Openstack-System-Scope: None Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: User-Agent: python-novaclient Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Auth-Token: gAAAAABi_Uwt5LtSfVQ-RfVPXz5PtuGRQjmGmiHlX_GBT5NowPF5D5EPVY1SVZkMZOHvQd1i9h_NBETr4ExQsIMPjnXmAxMdAT4SXrdAH94PxeLHk-56eoCeDVjn_28PirvoFSTrb0J3yoBqW6nBM5LRgKd_CxtqFu52QnQEhNwcS_jBM35vmWU Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Domain-Id: None Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Domain-Name: None Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Identity-Status: Confirmed Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Is-Admin-Project: True Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Domain-Id: default Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Domain-Name: Default Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Name: admin Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Role: member,admin,reader Aug 17 20:14:37.743343 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Roles: member,admin,reader Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant: admin Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant-Name: admin Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User: admin Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Domain-Id: default Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Domain-Name: Default Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Id: 55cfb5b1f26a4ec19b12e7ce5108fd60 Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Name: admin Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: method: > Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: exception: Flavor 84 could not be found. Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: action_args: {'id': '84'} Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:14:37.744713 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:37.745474 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.746497 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-9dc98167-0cce-48b9-8f9c-f2266a170239 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:14:37.747552 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-9dc98167-0cce-48b9-8f9c-f2266a170239 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.422148 Aug 17 20:14:37.747552 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 17 20:14:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:37.754331 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-d147db7f-a31d-4d77-b61a-054dfb147605 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:37.770382 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-d147db7f-a31d-4d77-b61a-054dfb147605 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019474 Aug 17 20:14:37.771709 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 17 20:14:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:14:37.781470 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-74df280f-4855-4a74-aada-9782363010f7 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:37.798373 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-74df280f-4855-4a74-aada-9782363010f7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020530 Aug 17 20:14:37.799135 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 17 20:14:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:14:37.809230 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-3226c463-00b7-4c84-b1bf-f2ccaab7978f admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:37.814653 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.wsgi [None req-3226c463-00b7-4c84-b1bf-f2ccaab7978f admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-3226c463-00b7-4c84-b1bf-f2ccaab7978f admin admin] Request method failure captured: Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Accept: application/json Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Accept-Encoding: gzip, deflate Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Connection: keep-alive Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Content-Length: 0 Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Host: 10.222.0.64 Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Openstack-Api-Version: compute 2.90 Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Openstack-System-Scope: None Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: User-Agent: python-novaclient Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Auth-Token: gAAAAABi_Uwt5LtSfVQ-RfVPXz5PtuGRQjmGmiHlX_GBT5NowPF5D5EPVY1SVZkMZOHvQd1i9h_NBETr4ExQsIMPjnXmAxMdAT4SXrdAH94PxeLHk-56eoCeDVjn_28PirvoFSTrb0J3yoBqW6nBM5LRgKd_CxtqFu52QnQEhNwcS_jBM35vmWU Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Domain-Id: None Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Domain-Name: None Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Identity-Status: Confirmed Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Is-Admin-Project: True Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Domain-Id: default Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Domain-Name: Default Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Name: admin Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Role: member,admin,reader Aug 17 20:14:37.816165 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Roles: member,admin,reader Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant: admin Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant-Name: admin Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User: admin Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Domain-Id: default Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Domain-Name: Default Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Id: 55cfb5b1f26a4ec19b12e7ce5108fd60 Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Name: admin Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: method: > Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: exception: Flavor 84 could not be found. Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: action_args: {'id': '84'} Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:14:37.818101 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:37.819308 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:37.820502 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-3226c463-00b7-4c84-b1bf-f2ccaab7978f admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:14:37.821453 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-3226c463-00b7-4c84-b1bf-f2ccaab7978f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012181 Aug 17 20:14:37.821453 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Wed Aug 17 20:14:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 17 20:14:38.837471 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-74df280f-4855-4a74-aada-9782363010f7 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:38.838472 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-74df280f-4855-4a74-aada-9782363010f7 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Aug 17 20:14:38.838910 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:39.390929 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-d4cdf661-7413-4fb5-bdd2-088c172adfd4 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:39.398141 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.wsgi [None req-d4cdf661-7413-4fb5-bdd2-088c172adfd4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-d4cdf661-7413-4fb5-bdd2-088c172adfd4 admin admin] Request method failure captured: Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Accept: application/json Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Accept-Encoding: gzip, deflate Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Connection: keep-alive Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Content-Length: 0 Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Host: 10.222.0.64 Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Openstack-Api-Version: compute 2.90 Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Openstack-System-Scope: None Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: User-Agent: python-novaclient Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Auth-Token: gAAAAABi_Uwuq0P9-IHzaGjgJqD0po8uK_Xd0fNPDX_zPGp5j9LQL-VUELurmIVXVYSd8ioWy71FTxOlmNBwj2j3cgeDKQ3E3MatzG1LSMcoMySe6sa2-AWxFhfzdex6ZTLXugjU116rdN5X1XH5K4ZzJflDur81UWuIMCGVUtV6dqNT77sfiPY Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Domain-Id: None Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Domain-Name: None Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Identity-Status: Confirmed Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Is-Admin-Project: True Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Domain-Id: default Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Domain-Name: Default Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Project-Name: admin Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Role: member,admin,reader Aug 17 20:14:39.399887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Roles: member,admin,reader Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant: admin Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-Tenant-Name: admin Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User: admin Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Domain-Id: default Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Domain-Name: Default Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Id: 55cfb5b1f26a4ec19b12e7ce5108fd60 Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: X-User-Name: admin Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: method: > Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: exception: Flavor 451 could not be found. Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: action_args: {'id': '451'} Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:14:39.401555 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:39.402350 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.403508 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-d4cdf661-7413-4fb5-bdd2-088c172adfd4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:14:39.404554 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-d4cdf661-7413-4fb5-bdd2-088c172adfd4 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.424585 Aug 17 20:14:39.404554 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 17 20:14:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 426 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:39.411374 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-c04f977f-2447-4170-8ce7-4854141a5932 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:39.426304 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-c04f977f-2447-4170-8ce7-4854141a5932 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018585 Aug 17 20:14:39.427090 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 17 20:14:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:14:39.437252 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:39.453128 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019600 Aug 17 20:14:39.453680 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Wed Aug 17 20:14:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:14:39.464430 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-7fa839ba-627b-4d20-bd39-28ba66b2133b admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:39.469833 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.wsgi [None req-7fa839ba-627b-4d20-bd39-28ba66b2133b admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-7fa839ba-627b-4d20-bd39-28ba66b2133b admin admin] Request method failure captured: Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Accept: application/json Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Accept-Encoding: gzip, deflate Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Connection: keep-alive Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Content-Length: 0 Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Host: 10.222.0.64 Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Openstack-Api-Version: compute 2.90 Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Openstack-System-Scope: None Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: User-Agent: python-novaclient Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Auth-Token: gAAAAABi_Uwuq0P9-IHzaGjgJqD0po8uK_Xd0fNPDX_zPGp5j9LQL-VUELurmIVXVYSd8ioWy71FTxOlmNBwj2j3cgeDKQ3E3MatzG1LSMcoMySe6sa2-AWxFhfzdex6ZTLXugjU116rdN5X1XH5K4ZzJflDur81UWuIMCGVUtV6dqNT77sfiPY Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Domain-Id: None Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Domain-Name: None Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Identity-Status: Confirmed Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Is-Admin-Project: True Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Openstack-Nova-Api-Version: 2.90 Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Domain-Id: default Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Domain-Name: Default Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Project-Name: admin Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Role: member,admin,reader Aug 17 20:14:39.471370 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Roles: member,admin,reader Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_036067fc874c4d13970eee6f98f3d00e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant: admin Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant-Id: 036067fc874c4d13970eee6f98f3d00e Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-Tenant-Name: admin Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User: admin Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Domain-Id: default Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Domain-Name: Default Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Id: 55cfb5b1f26a4ec19b12e7ce5108fd60 Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: X-User-Name: admin Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: method: > Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: exception: Flavor 451 could not be found. Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: action_args: {'id': '451'} Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:14:39.472828 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:39.474482 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: ERROR nova.api.openstack.wsgi Aug 17 20:14:39.476079 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-7fa839ba-627b-4d20-bd39-28ba66b2133b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:14:39.477303 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-7fa839ba-627b-4d20-bd39-28ba66b2133b admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011922 Aug 17 20:14:39.477303 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 17 20:14:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 17 20:14:40.456810 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:40.458346 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Aug 17 20:14:40.458770 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:41.017771 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-122eb233-9e59-43e5-8e30-7a58a8fa4aca admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:41.103808 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-122eb233-9e59-43e5-8e30-7a58a8fa4aca admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.504871 Aug 17 20:14:41.104360 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 17 20:14:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:14:42.119550 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:42.120557 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Aug 17 20:14:42.120956 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:42.691133 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-96c885f6-1edc-4673-bc81-d519105429cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:42.763590 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-96c885f6-1edc-4673-bc81-d519105429cf admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.497218 Aug 17 20:14:42.764145 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 17 20:14:42 2022] POST /compute/v2.1/flavors => generated 405 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:14:43.759456 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:43.760504 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Aug 17 20:14:43.760930 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:14:44.295502 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-438abb9e-23f9-4984-a1a1-4cac4e6f5bbe admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:44.369705 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-438abb9e-23f9-4984-a1a1-4cac4e6f5bbe admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.467269 Aug 17 20:14:44.370252 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 17 20:14:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:14:45.374507 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:45.375541 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 17 20:14:45.375944 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:14:45.937129 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-674829b5-591f-4aa5-9a10-43f76a831c80 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:14:46.025976 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-674829b5-591f-4aa5-9a10-43f76a831c80 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.508542 Aug 17 20:14:46.026536 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Wed Aug 17 20:14:45 2022] POST /compute/v2.1/flavors => generated 409 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:14:47.073052 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:47.074055 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Aug 17 20:14:47.074463 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:14:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:14:47.637472 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-ca32fbbd-86e7-490c-a7ae-5b8aa6ed8d40 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:14:47.658137 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-ca32fbbd-86e7-490c-a7ae-5b8aa6ed8d40 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.442366 Aug 17 20:14:47.658681 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Wed Aug 17 20:14:47 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:42.132788 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:42.133823 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-87fac0a2-0576-4222-9c20-4cc7b970056d admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Aug 17 20:15:42.134326 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 931 bytes} [Wed Aug 17 20:15:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:15:42.145877 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:42.547860 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-9b14e1ed-19d6-4513-8db0-f341f3007483 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:42.569792 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-9b14e1ed-19d6-4513-8db0-f341f3007483 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.428766 Aug 17 20:15:42.570337 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1292 bytes} [Wed Aug 17 20:15:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:15:42.592174 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG dbcounter [-] [106153] Writing DB stats nova_api:SELECT=14 {{(pid=106153) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:15:42.595901 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-da325a11-f8bc-42c3-8763-0f3a50dc3718 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:42.604309 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-da325a11-f8bc-42c3-8763-0f3a50dc3718 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013566 Aug 17 20:15:42.604843 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1283 bytes} [Wed Aug 17 20:15:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:42.617214 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-79cf30a9-7005-47ef-92b4-ce3f167ccdbf admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:42.624873 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-79cf30a9-7005-47ef-92b4-ce3f167ccdbf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011331 Aug 17 20:15:42.625386 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1286 bytes} [Wed Aug 17 20:15:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:42.637510 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:42.645946 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012157 Aug 17 20:15:42.646411 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1286 bytes} [Wed Aug 17 20:15:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:15:42.658146 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-76094658-8a9f-476a-a2b4-ff7969c3a071 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:15:42.667052 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-76094658-8a9f-476a-a2b4-ff7969c3a071 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012423 Aug 17 20:15:42.667579 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1283 bytes} [Wed Aug 17 20:15:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:19:14.462877 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:14.463887 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 17 20:19:14.464282 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:19:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:14.607771 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:SELECT=6 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:14.753682 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:14.756221 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:19:14.756221 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: warnings.warn(msg) Aug 17 20:19:14.757587 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:14.758061 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:14.758511 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:14.759273 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:14.759817 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:14.760411 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:14.795110 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-bca6162d-7ad3-4b12-b43b-1511076c1c24 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.188851 Aug 17 20:19:14.795676 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 17 20:19:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:19:15.762442 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:15.762442 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002146 Aug 17 20:19:15.762442 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:15.947894 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:15.950318 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:19:15.950318 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: warnings.warn(msg) Aug 17 20:19:15.951448 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:15.951924 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:15.952350 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:15.953083 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:15.953525 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:15.953936 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:15.973773 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-c9b58acc-5103-4fca-9960-f803f10fce1d admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076890 Aug 17 20:19:15.974319 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 17 20:19:15 2022] GET /compute/v2.1/os-services => generated 794 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:19:27.241996 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:27.243021 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Aug 17 20:19:27.243406 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:19:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:27.390222 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell0:SELECT=4 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:27.390976 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_cell1:SELECT=4 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:27.391590 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG dbcounter [-] [106154] Writing DB stats nova_api:SELECT=8 {{(pid=106154) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:19:27.439966 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:27.442356 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:19:27.442356 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: warnings.warn(msg) Aug 17 20:19:27.447909 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:27.447909 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:27.447909 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:27.447909 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:27.447909 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:27.448381 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:27.471535 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-0bbc55f3-a7de-4361-ab62-63916b097b69 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.085565 Aug 17 20:19:27.472032 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 17 20:19:27 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:19:28.316962 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: DEBUG nova.api.openstack.wsgi [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] Calling method '>' {{(pid=106153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:28.317971 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: INFO nova.api.openstack.requestlog [None req-43e5fcf9-3b65-46fe-8109-2e2dd7906ff5 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001507 Aug 17 20:19:28.321456 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: [pid: 106153|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Wed Aug 17 20:19:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:19:28.515384 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG nova.api.openstack.wsgi [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] Calling method '>' {{(pid=106154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:19:28.517897 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 17 20:19:28.517897 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: warnings.warn(msg) Aug 17 20:19:28.519025 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:28.519496 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:28.519918 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:28.520627 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:19:28.521083 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:19:28.521483 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: DEBUG oslo_concurrency.lockutils [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:19:28.544154 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: INFO nova.api.openstack.requestlog [None req-952febd3-d71d-4f7b-b500-6db08be9f80c admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.082945 Aug 17 20:19:28.544701 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: [pid: 106154|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Wed Aug 17 20:19:28 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:20:25.749853 dv-cinder-835384-19-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 17 20:20:25.750514 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: Wed Aug 17 20:20:25 2022 - graceful shutdown triggered... Aug 17 20:20:25.750975 dv-cinder-835384-19-iscsi devstack@n-api.service[106153]: Gracefully killing worker 1 (pid: 106153)... Aug 17 20:20:25.751376 dv-cinder-835384-19-iscsi devstack@n-api.service[106154]: Gracefully killing worker 2 (pid: 106154)... Aug 17 20:20:26.750836 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: worker 1 buried after 1 seconds Aug 17 20:20:26.751353 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: worker 2 buried after 1 seconds Aug 17 20:20:26.751353 dv-cinder-835384-19-iscsi devstack@n-api.service[106152]: goodbye to uWSGI. Aug 17 20:20:26.752404 dv-cinder-835384-19-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 17 20:20:26.752945 dv-cinder-835384-19-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 17 20:20:26.756000 dv-cinder-835384-19-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 17 20:20:26.766331 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Aug 17 20:20:26 2022] *** Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: nodename: dv-cinder-835384-19-iscsi Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: machine: x86_64 Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: clock source: unix Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: pcre jit disabled Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: detected number of CPU cores: 4 Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: current working directory: / Aug 17 20:20:26.767774 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: detected binary path: /usr/bin/uwsgi-core Aug 17 20:20:26.768437 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: your processes number limit is 47680 Aug 17 20:20:26.768437 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: your memory page size is 4096 bytes Aug 17 20:20:26.768437 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: detected max file descriptor number: 2048 Aug 17 20:20:26.768437 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: lock engine: pthread robust mutexes Aug 17 20:20:26.768437 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: thunder lock: enabled Aug 17 20:20:26.768437 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 17 20:20:26.768437 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 17 20:20:26.809131 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: Python main interpreter initialized at 0x563960bbb9c0 Aug 17 20:20:26.809131 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: python threads support enabled Aug 17 20:20:26.809131 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: your server socket listen backlog is limited to 100 connections Aug 17 20:20:26.809131 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: your mercy for graceful operations on workers is 90 seconds Aug 17 20:20:26.809569 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: mapped 403077 bytes (393 KB) for 2 cores Aug 17 20:20:26.809569 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: *** Operational MODE: preforking *** Aug 17 20:20:26.809859 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: *** uWSGI is running in multiple interpreter mode *** Aug 17 20:20:26.810016 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: spawned uWSGI master process (pid: 121254) Aug 17 20:20:26.810334 dv-cinder-835384-19-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 17 20:20:26.812529 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: spawned uWSGI worker 1 (pid: 121275, cores: 1) Aug 17 20:20:26.813033 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: spawned uWSGI worker 2 (pid: 121276, cores: 1) Aug 17 20:20:26.813306 dv-cinder-835384-19-iscsi devstack@n-api.service[121254]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 17 20:20:27.487810 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 20:20:27.489123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 17 20:20:28.662808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:20:28.662808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: from cryptography.utils import int_from_bytes Aug 17 20:20:28.663434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:20:28.663434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: from cryptography.utils import int_from_bytes Aug 17 20:20:28.663860 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:20:28.663860 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: from cryptography.utils import int_from_bytes Aug 17 20:20:28.663989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 17 20:20:28.663989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: from cryptography.utils import int_from_bytes Aug 17 20:20:30.997389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 20:20:30.997953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 17 20:20:30.998318 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 20:20:30.998420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 17 20:20:30.998524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 20:20:30.998617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 17 20:20:30.998738 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 20:20:30.998829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 17 20:20:30.998920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 20:20:30.999016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 17 20:20:30.999137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:30.999374 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:30.999556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:30.999783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:30.999993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.000123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.000363 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.000467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.000699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.000799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.001041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.001143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.001366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.001465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.001700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.001813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.002020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.002180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.002314 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.002467 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.002613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.002781 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-19-iscsi {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.002951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.003092 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.003270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.003403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-835384-19-iscsi {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.003587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.003758 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.003898 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.004034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.004208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.004358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.004536 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.004678 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.004849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.004992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.005180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.005356 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.005520 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.006091 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.006254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.006404 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.006571 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.006757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.006920 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.007110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.007232 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.007458 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.007639 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.007848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.008044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.008230 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.008435 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.008629 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.008830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.009027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.009219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.009401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.009590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.009795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-19-iscsi {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.009989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.010183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.010375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-835384-19-iscsi {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.010557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.010780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.010966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.011154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.011353 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.011536 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.011744 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.012089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.012262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.012425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.012656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.012766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.012923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.013923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.014042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.014151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.014259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.014376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.014486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.014594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.015263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.015389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.015563 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.015753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.015961 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.015961 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.016303 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.016429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.016538 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.016538 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.016759 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.016876 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.016996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.017105 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.017239 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.017446 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.017574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.026509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.026613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.026724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.026813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.026897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.026969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027048 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027205 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027287 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027584 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027665 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.027958 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028026 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028103 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028585 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028663 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.028955 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029032 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029204 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029502 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029502 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029807 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029885 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.029967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.030044 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.030121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.030191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.030267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.030359 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031102 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031255 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031406 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031660 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031736 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031812 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031895 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.031966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.032818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.032986 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.033146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.033293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.033453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.033606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.033758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.033903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.034057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.034286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.034434 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.034580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.034827 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.034994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.035177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.035337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.035493 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.035639 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.035783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.035928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.036081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.036239 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.036239 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.036534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.036688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.036834 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.036989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.037152 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.037305 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.037452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.037603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.037749 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.037901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.038059 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.038207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.038944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.039109 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.039266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.039430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.039588 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.039735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.039887 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.040041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.040197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.040363 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.040520 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.040666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.040666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.040981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.041127 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.041287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.041440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.041593 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.041745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.041898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.042051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.042256 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.042256 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.042537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.042700 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.043001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.043153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.043310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.043459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.043605 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.043757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.043903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.044055 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.044214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.044368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.044515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.044659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.044804 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.045009 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.045174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.045322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.045468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.045619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.045772 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.045932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.046130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.046286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.046440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.046596 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.046771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.046947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.047113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.047259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.047411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.047557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.047713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.047868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.048021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.048174 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.048330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.048521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.049259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.049416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.049569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.049727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.049872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.050024 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.050182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.050348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.050502 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 17 20:20:31.050668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.050821 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.050977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.051137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.051284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.051428 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.051428 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.051713 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.051859 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.052019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.052175 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.052371 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.052522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.052666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.052821 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.052968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.053112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.053257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.053257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.053557 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.053715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.053863 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.054015 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.054168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.054321 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.054466 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.054621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.054838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.054984 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.055148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.055303 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.055470 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.055625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.055780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.055780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.056067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.056211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.056356 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.056508 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.056669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.056822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.056975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.057129 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.057284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.057449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.057603 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.057756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.057902 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.058055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.058201 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.058362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.058509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.058779 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.059421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.059713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.059867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.060037 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.060201 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.060351 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.060505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.060651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.060803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.060959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.061106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.061252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.061404 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.061550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.061860 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.062021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.062178 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.062325 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.062525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.062726 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.062894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.063050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.063197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.063351 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.063497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.063649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.063804 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.063958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.064103 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.064268 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.064415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.064561 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.064719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.064874 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.065020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.065172 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.065325 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.065486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.065632 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.065778 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.065922 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.066066 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.066221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.066375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.066530 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.066692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.066843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.067003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.067158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.067313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.067467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.067613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.067765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.067918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.068063 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.068236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.068390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.068546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.068700 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.068966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.069601 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.069850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.070003 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.070156 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.070305 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.070451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.070606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.070798 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.070957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.071104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.071257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.071410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.071565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.071713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.071859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.072010 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.072162 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.072308 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.072508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.072676 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.072848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.073002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.073155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.073301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.073460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.073614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.073762 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.073915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.074069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.074233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.074379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.074524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.074687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.074855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.075012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.075173 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.075173 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.075497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.075656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.075802 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.075957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.076117 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.076265 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.076418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.076588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.077796 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.077976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.078125 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.078280 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.078451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.078709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.078878 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.079300 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.079695 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.079865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.080087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.080264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.080507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.080682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.080838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.080993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.081140 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.081286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.081430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.081589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.081743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.081897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.082050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.082205 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.082350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.082547 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.082730 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.082880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.083037 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.083184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.083346 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.083500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.083646 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.083799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.083956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.084103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.084259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.084413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.084572 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.084729 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.084874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.085035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.085192 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.085340 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.085492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.085650 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.085805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.085964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.086111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.086258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.086403 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.086547 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.086774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.086938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.087093 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.087247 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.087392 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.087537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.087690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.087845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.087991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.088137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.088290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.088436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.088590 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.088745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.088891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.089043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.089419 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.089819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.089976 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.090221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.090385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.090558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.090822 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.090975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.091136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.091293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.091447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.091603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.091757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.091911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.092071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.092218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.092364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.092509 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.092696 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.092858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.093558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.093750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.093947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.094102 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.094257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.094403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.094681 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.094838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.094985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.095142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.095290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.095445 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.095592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.095745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.095892 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.096057 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.096211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.096367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.096524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.096683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.096838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.096992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.097139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.097293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.097439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.097584 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.097764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.098044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.098212 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.098369 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.098516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.098692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.098853 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.099001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.099155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.099636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.100085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.100346 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.100507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.100655 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.100830 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.101085 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.101238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.101385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.101542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.101697 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.101854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.102002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.102149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.102296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.102441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.102587 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.102813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.102984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.103148 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.103294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.103439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.103585 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.103745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.103900 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.104046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.104201 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.104349 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.104508 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.104655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.104809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.104965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.105111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.105266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.105426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.105579 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.105725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.105870 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.106015 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.106176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.106339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.106492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.106664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.106823 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.106986 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.107151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.107313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.107475 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.107635 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.107787 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.107938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.108197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.108364 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.108579 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.108741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.108894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.109047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.109225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.109388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.109732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.109893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.110351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.110598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.110843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.111000 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.111264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.111431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.111586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.111740 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.111908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.112083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.112244 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.112397 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.112549 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.112713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.112924 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.113082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.113242 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.113396 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.113549 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.113712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.113874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.114046 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.114200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.114352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.114504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.114762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.114922 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.115074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.115228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.115399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.115563 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.115728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.115889 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.116042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.116212 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.116373 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.116541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.116697 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.116850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.117012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.117172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.117326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.117488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.117657 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.117820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.117981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.118141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.118399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.118568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.118568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.118931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.118931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.119247 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.119410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.119564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.119901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.120071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.120480 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.120736 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.120922 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.121087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.121268 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.121520 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.121520 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.121820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.122023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.122180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.122333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.122501 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.122682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.122843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.123038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.123221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.123376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.123537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.123691 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.123853 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.124014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.124558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.124718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.124872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.125034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.125189 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.125348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.125512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.125677 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.125831 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.125991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.126144 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.126313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.126531 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.126817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.126996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.127151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.127305 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.127544 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.127710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.127871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.128044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.128206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.128386 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.128659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.128889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.129113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.129323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.129510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.129665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.130017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.130203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.130991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.131169 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.131331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.131498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.131662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.131835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.132094 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.132261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.132417 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.132588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.132751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.132913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.133124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.133293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.133459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.133628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.133790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.133943 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.134104 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.134257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.134421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.134577 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.134798 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.134954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.135115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.135303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.135470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.135644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.135813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.135975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.136136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.136290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.136524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.136682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.136835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.136987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.137147 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.137300 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.137462 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.137637 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.137799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.137961 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.138114 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.138274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.138437 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.138616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.138886 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.139044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.139197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.139367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.139522 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.139675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.140831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.140831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.141383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.141556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.141556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.141859 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.142030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.142316 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.142485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.142667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.142840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.142995 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.143204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.143465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.143625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.143790 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.143953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.144116 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.144270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.144431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.144599 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.144754 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.144915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.145077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.145232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.145385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.145558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.145725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.145880 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.146040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.146194 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.146347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.146514 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.146741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.146901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.147055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.147220 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.147375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.147541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.147706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.147860 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.148012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.148166 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.148330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.148491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.148644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.148797 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.149039 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.149199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.149364 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.149518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.149690 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.149851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.150013 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.150173 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.150342 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.150515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.151413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.151577 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.151743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.151898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.152067 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.152230 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.152496 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.152669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.152823 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.152986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.153141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.153344 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.153503 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.153657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.153810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.153983 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.154144 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.154305 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.154459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.154655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.154842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.155006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.155161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.155315 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.156014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.156173 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.156326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.156488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.156643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.156795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.156948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.157100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.157262 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.157426 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.157593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.157757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.157917 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.158078 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.158247 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.158402 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.158562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.158775 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.158940 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.159189 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.159359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.159520 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.159684 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.159846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.160008 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.160162 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.160329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.160491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.160666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.161158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.161433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.161703 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.161864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.162025 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.162197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.162358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.162529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.162813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.162976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.163137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.163290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.163499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.163653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.163812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.163973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.164112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.164250 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.164410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.164549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.164717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.164878 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.165033 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.165185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.165352 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.165506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.165672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.165834 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.165987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.166149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.166310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.166489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.166701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.166871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.167033 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.167196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.167356 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.167525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.167688 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.167842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.167995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.168149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.168302 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.168464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.168641 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.168796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.168948 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.168948 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.169352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.169519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.169674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.169674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.169963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.170125 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.170364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.170364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.170708 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.170877 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.171446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.171718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.171999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.172159 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.172313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.172476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.172638 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.172821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.173093 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.173258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.173463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.173633 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.173788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.173941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.174104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.174258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.174412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.174575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.174751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.174928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.174928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.175230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.175391 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.175597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.175767 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.175939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.176099 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.176252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.176404 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.176404 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.176404 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.176855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.177018 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.177172 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.177333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.177486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.177638 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.177857 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.178023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.178177 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.178341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.178494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.178494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.178874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.179029 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.179181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.179181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.179589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.179759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.179924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.179924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.180213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.180213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.180520 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.180698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.180854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.181008 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.181186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.181685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.181936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.182711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.183632 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.183799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.183964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.184130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.184284 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.184447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.184609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.184788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.184788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.185083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.185235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.185396 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.185558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.185724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.185877 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.186031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.186191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.186344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.186504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.186801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.186992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.187214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.187379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.187532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.187957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.188138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.188294 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.188455 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.188609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.188770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.188933 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.189094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.189262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.189262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.189580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.189813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.189987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.190141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.190307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.190478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.190478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.190478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.191009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.191180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.191343 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.191343 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.192081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.192265 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.192535 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.192694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.192847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.193008 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.193170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.193170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.193645 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.193806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.193806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.194104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.194276 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.194445 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.194600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.194777 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.194931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.195103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.195258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.195496 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.195653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.195805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.195965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.196119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.196282 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.196449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.196612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.196767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.196919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.197086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.197254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.197407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.197407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.197706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.197858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.198017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.198180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.198351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.198505 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.198712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.198712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.199009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.199174 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.199335 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.199495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.199649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.199819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.200126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.200298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.200463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.200627 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.200795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.200954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.201117 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.201273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.201273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.201565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.202058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.202994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.203212 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.203381 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.203641 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.203862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.204021 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.204174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.204338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.204499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.204653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.204805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.204959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.205123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.205283 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.205436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.205596 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.205757 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.205923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.206085 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.206246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.206400 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.206561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.206842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.207010 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.207186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.207348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.207502 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.207502 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.207794 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.207946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.208124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.208286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.208446 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.208608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.208769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.208935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.209091 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.209243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.209394 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.209554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.209709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.209871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.210023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.210288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.210288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.210594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.210822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.210991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.211154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.211317 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.211481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.211635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.211813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.212298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.212544 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.212722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.212903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.213159 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.213368 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.213525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.213789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.214003 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.214170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.214335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.214500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.214691 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.214851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.215004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.215183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.215338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.215338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.215651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.215804 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.215804 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.216110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.216272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.216427 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.216579 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.216740 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.216900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.217064 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.217231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.217389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.217542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.217697 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.217893 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.218538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.218732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.218890 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.219053 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.219827 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.219991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.220146 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.220325 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.220569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.220742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.220897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.221058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.221211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.221375 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.221540 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.221696 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.221696 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.222023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.222552 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.222854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.223026 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.223207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.223476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.223636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.223809 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.224120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.224294 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.224451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.224625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.224780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.224934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.225095 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.225249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.225408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.225568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.225722 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.225876 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.226043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.226205 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.226359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.226561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.226752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.226920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.226920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.227326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.227494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.227657 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.227819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.227987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.228149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.228312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.228466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.228627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.228831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.229157 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.229334 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.229497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.229659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.229813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.229966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.230135 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.230290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.230457 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.230747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.230909 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.231079 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.231079 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.231406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.231406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.232328 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.232936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233042 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233391 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233884 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.233964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.234131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.234231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.234713 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.234827 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.234967 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.235090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.235219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.235383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.235510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.235631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.235752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.235873 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236009 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236384 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.236977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237789 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.237954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238117 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238548 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.238967 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239654 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.239960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240206 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240561 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240643 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240749 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.240918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241015 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241107 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241349 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241432 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241790 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.241971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.242141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.242233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.242332 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.242425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.242519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.242599 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.242702 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243204 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243392 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243483 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243652 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.243926 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244887 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.244973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245047 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245311 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245749 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.245928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246187 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246353 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246536 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246811 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.246914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247268 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247476 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.247920 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248011 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248202 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248202 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248520 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248614 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248800 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248892 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.248986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.249070 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.249687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.249762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250828 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.250918 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251019 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251105 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251188 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251354 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251708 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251791 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251881 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.251978 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252224 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.252927 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253343 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253779 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253870 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.253962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254046 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254490 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254697 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.254919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255169 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255885 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.255975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256167 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256863 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.256934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257061 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257247 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257514 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257697 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.257940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258654 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258845 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.258942 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259452 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259543 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259713 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259793 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.259940 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260169 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260241 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260464 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260834 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.260999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261265 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261437 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261630 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261823 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.261918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262008 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262195 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262361 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262526 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262618 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.262890 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.263001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.263108 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.263414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.263546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.263669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.263784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.263903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.264027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.264149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.264269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.264383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.264496 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.264608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.264814 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.265505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.265630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.265758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.265882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.265995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.266179 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.266406 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.266534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.266722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.266843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.266956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267536 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267536 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267754 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.267988 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.268099 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.268218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.268338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121276) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 20:20:31.268460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.268460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.268460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.268460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.268876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.269111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.270495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.270495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.270495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.270495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.270947 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.271946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.272305 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.272648 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.273030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.273532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.273722 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.274068 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.274399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.274747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.275070 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 17 20:20:31.275726 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121275) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 17 20:20:31.422107 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Registered counter for database nova_api Aug 17 20:20:31.431344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO dbcounter [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Registered counter for database nova_api Aug 17 20:20:31.443134 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.450162 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:31.453095 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_db.sqlalchemy.engines [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.460224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writer thread running {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:31.508625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.context [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb200869-c0cd-497b-a077-1c09d01e21d1(cell1) {{(pid=121276) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 20:20:31.512597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:31.513075 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:31.514726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:31.516013 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:31.516464 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:31.518440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.context [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),eb200869-c0cd-497b-a077-1c09d01e21d1(cell1) {{(pid=121275) load_cells /opt/stack/nova/nova/context.py:464}} Aug 17 20:20:31.518542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:31.520595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Registered counter for database nova_cell0 Aug 17 20:20:31.522446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:31.522953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:31.524524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:31.524772 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Registered counter for database nova_cell1 Aug 17 20:20:31.525278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:20:31.525728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:20:31.527966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:20:31.529862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO dbcounter [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Registered counter for database nova_cell0 Aug 17 20:20:31.532048 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.533957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.534276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO dbcounter [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Registered counter for database nova_cell1 Aug 17 20:20:31.540142 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:31.541526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_db.sqlalchemy.engines [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.542272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:31.543370 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_db.sqlalchemy.engines [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.549730 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writer thread running {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:31.552251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writer thread running {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:31.690603 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO dbcounter [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Registered counter for database nova_cell0 Aug 17 20:20:31.697468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_db.sqlalchemy.engines [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121276) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.699579 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO dbcounter [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Registered counter for database nova_cell0 Aug 17 20:20:31.702007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writer thread running {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:31.708637 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_db.sqlalchemy.engines [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121275) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 17 20:20:31.713212 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writer thread running {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 17 20:20:32.028281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:20:32.037559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:20:32.041192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: WARNING keystonemiddleware.auth_token [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:20:32.048089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: WARNING keystonemiddleware.auth_token [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:20:32.392553 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:20:32.398661 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: WARNING keystonemiddleware.auth_token [None req-f53e20b7-6f9f-47dc-bba2-194f093236fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:20:32.404181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: WARNING keystonemiddleware.auth_token [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 17 20:20:32.405059 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563960bbb9c0 pid: 121276 (default app) Aug 17 20:20:32.410538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: WARNING keystonemiddleware.auth_token [None req-c959c4b7-d54f-47b6-8b6a-c89eb07d1eab None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 17 20:20:32.416856 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x563960bbb9c0 pid: 121275 (default app) Aug 17 20:21:09.297667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:09.298758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:09.300224 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:09.301497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.782364 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.793627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.793627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:10.793627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:11.024286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6325e7f0-257f-428a-80f1-cee7e287bd40 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Action: 'create', calling method: .version_select at 0x7f23e3d5f280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1645846706"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:12.268864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-47413c33-8d8c-4b0f-8299-e998b2771960 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Action: 'create', calling method: .version_select at 0x7f23e3d5f280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-967470567", "metadata": {"Type": "work"}}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-47413c33-8d8c-4b0f-8299-e998b2771960 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Request method failure captured: Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 121 Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U22qTiT9bpFPJZcAo4rO5Fbw8dIMO6vq5_smvR58J8ylZzjue6rHiwEx4QWHpAFYi9TKJExr7iWL64w8Fi6_Uzuk9gAc74zomjn4IjS78heyUiuz5eElgu3jZbuT3gWy6_dCchU-7rhVW3FKPKqfOVS7omMeT4YYaRhZo-WC-uC3Uk Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:12.275621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: ae007a5ecc3d4116b2a35b3773e9ece4 Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-967470567", "metadata": {"Type": "work"}}} Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:12.277258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-967470567', 'metadata': {'Type': 'work'}}}} Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise error Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi '#$%' Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:12.278219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 20:21:12.280554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 20:21:12.282025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 17 20:21:12.282025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.283188 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-47413c33-8d8c-4b0f-8299-e998b2771960 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:12.284558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-47413c33-8d8c-4b0f-8299-e998b2771960 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.514186 Aug 17 20:21:12.291242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 17 20:21:10 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1517 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:21:12.299760 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2a2d4d11-24ca-40a3-a7a6-5a557e0335f0 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Action: 'create', calling method: .version_select at 0x7f23e3d5ff70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2013830821", "metadata": {"Type": "work"}}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2a2d4d11-24ca-40a3-a7a6-5a557e0335f0 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Request method failure captured: Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 120 Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U22qTiT9bpFPJZcAo4rO5Fbw8dIMO6vq5_smvR58J8ylZzjue6rHiwEx4QWHpAFYi9TKJExr7iWL64w8Fi6_Uzuk9gAc74zomjn4IjS78heyUiuz5eElgu3jZbuT3gWy6_dCchU-7rhVW3FKPKqfOVS7omMeT4YYaRhZo-WC-uC3Uk Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:12.304362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: ae007a5ecc3d4116b2a35b3773e9ece4 Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2013830821", "metadata": {"Type": "work"}}} Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:12.305895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2013830821', 'metadata': {'Type': 'work'}}}} Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise error Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi '0' Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:12.306973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 20:21:12.308808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 20:21:12.309908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 17 20:21:12.309908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.309908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2a2d4d11-24ca-40a3-a7a6-5a557e0335f0 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:12.309908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2a2d4d11-24ca-40a3-a7a6-5a557e0335f0 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.013706 Aug 17 20:21:12.311356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 2/2] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 17 20:21:12 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:21:12.317371 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f1ebec6b-3c56-4928-97f9-461a7795d853 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Action: 'create', calling method: .version_select at 0x7f23e3c6aee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1036271832", "metadata": {"Type": "work"}}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f1ebec6b-3c56-4928-97f9-461a7795d853 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Request method failure captured: Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 119 Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U22qTiT9bpFPJZcAo4rO5Fbw8dIMO6vq5_smvR58J8ylZzjue6rHiwEx4QWHpAFYi9TKJExr7iWL64w8Fi6_Uzuk9gAc74zomjn4IjS78heyUiuz5eElgu3jZbuT3gWy6_dCchU-7rhVW3FKPKqfOVS7omMeT4YYaRhZo-WC-uC3Uk Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:12.321082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: ae007a5ecc3d4116b2a35b3773e9ece4 Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1036271832", "metadata": {"Type": "work"}}} Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:12.322905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1036271832', 'metadata': {'Type': 'work'}}}} Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise error Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi '' Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:12.323700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 17 20:21:12.325359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 17 20:21:12.327094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 17 20:21:12.327094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:12.327094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f1ebec6b-3c56-4928-97f9-461a7795d853 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:12.327094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f1ebec6b-3c56-4928-97f9-461a7795d853 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010158 Aug 17 20:21:12.327094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 3/3] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 17 20:21:12 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:21:12.337575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-45a6ad89-a418-416e-a87f-8870ce6f4ff2 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Calling method '.version_select at 0x7f23e3c6ab80>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:13.396089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-45a6ad89-a418-416e-a87f-8870ce6f4ff2 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] HTTP exception thrown: Volume tempest-invalid-1268501502 could not be found. Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-45a6ad89-a418-416e-a87f-8870ce6f4ff2 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Request method failure captured: Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1268501502 HTTP/1.1 Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U22qTiT9bpFPJZcAo4rO5Fbw8dIMO6vq5_smvR58J8ylZzjue6rHiwEx4QWHpAFYi9TKJExr7iWL64w8Fi6_Uzuk9gAc74zomjn4IjS78heyUiuz5eElgu3jZbuT3gWy6_dCchU-7rhVW3FKPKqfOVS7omMeT4YYaRhZo-WC-uC3Uk Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:13.400797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: ae007a5ecc3d4116b2a35b3773e9ece4 Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Volume tempest-invalid-1268501502 could not be found. Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': 'tempest-invalid-1268501502'} Aug 17 20:21:13.401911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1268501502 could not be found. (HTTP 404) (Request-ID: req-d0cecbaf-4023-4a3c-8009-2642abc1fcfd) Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:13.402473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:21:13.403304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1268501502 could not be found. Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:21:13.405055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1268501502 could not be found. Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1268501502 could not be found. Aug 17 20:21:13.406382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.416975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-45a6ad89-a418-416e-a87f-8870ce6f4ff2 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Returning 404 to user: Volume tempest-invalid-1268501502 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:13.421106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-45a6ad89-a418-416e-a87f-8870ce6f4ff2 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1268501502" status: 404 len: 99 microversion: 2.1 time: 1.087429 Aug 17 20:21:13.429913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 4/4] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 17 20:21:12 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1268501502 => generated 99 bytes in 1100 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 17 20:21:13.459531 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-175f8fcf-97bd-4cd9-8beb-240bdd222671 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.022706 Aug 17 20:21:13.463308 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 5/5] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Aug 17 20:21:13 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 33 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 17 20:21:13.483359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-554835fa-6f01-4798-a0e5-0a55245c1327 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004430 Aug 17 20:21:13.486197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 6/6] 10.222.0.64 () {58 vars in 1137 bytes} [Wed Aug 17 20:21:13 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 9 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Aug 17 20:21:13.505322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2fa1b8a2-e497-4088-b204-6af6302d682b tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Calling method '.version_select at 0x7f23e3b4b1f0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:13.594049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6325e7f0-257f-428a-80f1-cee7e287bd40 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.319803 Aug 17 20:21:13.597381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 1/7] 10.222.0.64 () {60 vars in 1155 bytes} [Wed Aug 17 20:21:09 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4323 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 20:21:13.619704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e00b8e12-8b42-4a58-9c7d-0eb5dfdb7d92 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3bbf160>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:13.801755 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-2fa1b8a2-e497-4088-b204-6af6302d682b tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] HTTP exception thrown: Volume 36b9f841-75ce-410c-9539-e6a29ce630d2 could not be found. Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2fa1b8a2-e497-4088-b204-6af6302d682b tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Request method failure captured: Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/os-volumes/36b9f841-75ce-410c-9539-e6a29ce630d2 HTTP/1.1 Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U22qTiT9bpFPJZcAo4rO5Fbw8dIMO6vq5_smvR58J8ylZzjue6rHiwEx4QWHpAFYi9TKJExr7iWL64w8Fi6_Uzuk9gAc74zomjn4IjS78heyUiuz5eElgu3jZbuT3gWy6_dCchU-7rhVW3FKPKqfOVS7omMeT4YYaRhZo-WC-uC3Uk Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:13.805376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: ae007a5ecc3d4116b2a35b3773e9ece4 Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Volume 36b9f841-75ce-410c-9539-e6a29ce630d2 could not be found. Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '36b9f841-75ce-410c-9539-e6a29ce630d2'} Aug 17 20:21:13.806612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 36b9f841-75ce-410c-9539-e6a29ce630d2 could not be found. (HTTP 404) (Request-ID: req-79eb239b-33d2-49e0-ad03-cef5e0024d9e) Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:13.807462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:21:13.808484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 36b9f841-75ce-410c-9539-e6a29ce630d2 could not be found. Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 20:21:13.809532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 36b9f841-75ce-410c-9539-e6a29ce630d2 could not be found. Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 36b9f841-75ce-410c-9539-e6a29ce630d2 could not be found. Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2fa1b8a2-e497-4088-b204-6af6302d682b tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Returning 404 to user: Volume 36b9f841-75ce-410c-9539-e6a29ce630d2 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2fa1b8a2-e497-4088-b204-6af6302d682b tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/36b9f841-75ce-410c-9539-e6a29ce630d2" status: 404 len: 109 microversion: 2.1 time: 0.315844 Aug 17 20:21:13.811130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 7/8] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:21:13 2022] DELETE /compute/v2.1/os-volumes/36b9f841-75ce-410c-9539-e6a29ce630d2 => generated 109 bytes in 318 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:21:13.822339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-be0f88c1-9b19-4206-a964-9950fa0b88e7 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Calling method '.version_select at 0x7f23e3b9fc10>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:14.735862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e00b8e12-8b42-4a58-9c7d-0eb5dfdb7d92 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb" status: 200 len: 345 microversion: 2.1 time: 1.129953 Aug 17 20:21:14.737395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 2/9] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:13 2022] GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb => generated 345 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:21:14.769427 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-be0f88c1-9b19-4206-a964-9950fa0b88e7 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] HTTP exception thrown: Volume f40a7317-2321-4726-ae5c-b4d511988acd could not be found. Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-be0f88c1-9b19-4206-a964-9950fa0b88e7 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Request method failure captured: Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/os-volumes/f40a7317-2321-4726-ae5c-b4d511988acd HTTP/1.1 Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U22qTiT9bpFPJZcAo4rO5Fbw8dIMO6vq5_smvR58J8ylZzjue6rHiwEx4QWHpAFYi9TKJExr7iWL64w8Fi6_Uzuk9gAc74zomjn4IjS78heyUiuz5eElgu3jZbuT3gWy6_dCchU-7rhVW3FKPKqfOVS7omMeT4YYaRhZo-WC-uC3Uk Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:14.771099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_2e21a797dfb14b448d787ed516fd4abe"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 2e21a797dfb14b448d787ed516fd4abe Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesNegativeTest-1187847031 Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: ae007a5ecc3d4116b2a35b3773e9ece4 Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesNegativeTest-1187847031-project Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Volume f40a7317-2321-4726-ae5c-b4d511988acd could not be found. Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': 'f40a7317-2321-4726-ae5c-b4d511988acd'} Aug 17 20:21:14.776877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f40a7317-2321-4726-ae5c-b4d511988acd could not be found. (HTTP 404) (Request-ID: req-de5c1979-516b-40ba-8d0e-c7b7d6065d13) Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:14.777568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:14.778596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f40a7317-2321-4726-ae5c-b4d511988acd could not be found. Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:21:14.779545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f40a7317-2321-4726-ae5c-b4d511988acd could not be found. Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f40a7317-2321-4726-ae5c-b4d511988acd could not be found. Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-be0f88c1-9b19-4206-a964-9950fa0b88e7 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] Returning 404 to user: Volume f40a7317-2321-4726-ae5c-b4d511988acd could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-be0f88c1-9b19-4206-a964-9950fa0b88e7 tempest-VolumesNegativeTest-1187847031 tempest-VolumesNegativeTest-1187847031-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/f40a7317-2321-4726-ae5c-b4d511988acd" status: 404 len: 109 microversion: 2.1 time: 0.956394 Aug 17 20:21:14.780559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 8/10] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:13 2022] GET /compute/v2.1/os-volumes/f40a7317-2321-4726-ae5c-b4d511988acd => generated 109 bytes in 959 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:21:15.750907 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-64bf7c06-c908-4442-bcfd-547bd4717929 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3bbf820>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:15.860778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-64bf7c06-c908-4442-bcfd-547bd4717929 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb" status: 200 len: 346 microversion: 2.1 time: 0.113671 Aug 17 20:21:15.864197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 3/11] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:15 2022] GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb => generated 346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:15.883879 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ae86806c-28d5-4c0a-a7c9-febe2520a041 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Action: 'create', calling method: .version_select at 0x7f23e3c6a670>, body: {"snapshot": {"volume_id": "61881e51-974c-41c9-b0ff-e9d493e7e7cb", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-826652449"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:17.742689 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ae86806c-28d5-4c0a-a7c9-febe2520a041 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 1.871968 Aug 17 20:21:17.743948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 9/12] 10.222.0.64 () {60 vars in 1162 bytes} [Wed Aug 17 20:21:15 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 1874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:17.755131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-34703889-6ce3-4553-87a0-02e21e986bc0 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3bbfee0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:17.857918 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-34703889-6ce3-4553-87a0-02e21e986bc0 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 200 len: 286 microversion: 2.1 time: 0.106295 Aug 17 20:21:17.859051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 4/13] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:21:17 2022] GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 286 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:17.876153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-18d395a5-5b49-47a9-a8cb-94c08ea447e7 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b4b940>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:18.074906 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-18d395a5-5b49-47a9-a8cb-94c08ea447e7 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.205850 Aug 17 20:21:18.074906 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 10/14] 10.222.0.64 () {58 vars in 1140 bytes} [Wed Aug 17 20:21:17 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:18.087984 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-03d65b86-925c-4671-a988-9c6888a46eb6 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3bbf940>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:18.210610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-03d65b86-925c-4671-a988-9c6888a46eb6 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 200 len: 286 microversion: 2.1 time: 0.127066 Aug 17 20:21:18.210610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 5/15] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:21:18 2022] GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 286 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:19.223034 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1a6ee6a5-8ba7-4c14-97b4-1e01155ef4b2 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b54b80>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:19.479730 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1a6ee6a5-8ba7-4c14-97b4-1e01155ef4b2 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 200 len: 286 microversion: 2.1 time: 0.260371 Aug 17 20:21:19.482314 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 11/16] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:21:19 2022] GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 286 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:20.499707 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bc912307-f075-4b61-8cad-b0fd427c457a tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3bbf430>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:20.557893 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bc912307-f075-4b61-8cad-b0fd427c457a tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 200 len: 286 microversion: 2.1 time: 0.064243 Aug 17 20:21:20.564959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 6/17] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:21:20 2022] GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 286 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:21.572374 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-71289c26-c8f5-416d-89f1-a05d44f09553 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b54670>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:21.724904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-71289c26-c8f5-416d-89f1-a05d44f09553 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 200 len: 287 microversion: 2.1 time: 0.156839 Aug 17 20:21:21.729555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 12/18] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:21:21 2022] GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:21.737568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6e4db466-57bb-4c22-8c93-14a98da4595b tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3bc9040>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:22.072900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6e4db466-57bb-4c22-8c93-14a98da4595b tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 202 len: 0 microversion: 2.1 time: 0.339559 Aug 17 20:21:22.073653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 7/19] 10.222.0.64 () {58 vars in 1254 bytes} [Wed Aug 17 20:21:21 2022] DELETE /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:21:22.082938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2c096af7-ab67-4f76-9e97-f9c15af133b6 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b9ff70>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:22.238248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2c096af7-ab67-4f76-9e97-f9c15af133b6 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 200 len: 286 microversion: 2.1 time: 0.159865 Aug 17 20:21:22.239731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 13/20] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:21:22 2022] GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:23.261374 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cec6b267-76ea-4d6b-a47e-7eee2b12e335 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b9f9d0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:23.437038 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-cec6b267-76ea-4d6b-a47e-7eee2b12e335 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] HTTP exception thrown: Snapshot a0241d85-8d8e-4581-9411-fb8b77525c33 could not be found. Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cec6b267-76ea-4d6b-a47e-7eee2b12e335 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Request method failure captured: Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 HTTP/1.1 Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U21BJgReRpPqbIcFLYWwBO5PZQbwm7U-Bt0DHJHducXv_QuFjkd1HvqdIwzvcDVTYW_vLKjlkL4lAMAa-w0EPLg4THp9rhSm4gnEFppLR1-k97K2Gh8Zm1nnljvJrwcSG6gMZz10g5yqc7BdZQE6saBgNQOh8gJ_b1-0eZuhxRmSJA Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:23.440185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: c339948fd8e64dd0afeaddbe8c5eb533 Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Snapshot a0241d85-8d8e-4581-9411-fb8b77525c33 could not be found. Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': 'a0241d85-8d8e-4581-9411-fb8b77525c33'} Aug 17 20:21:23.441294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a0241d85-8d8e-4581-9411-fb8b77525c33 could not be found. (HTTP 404) (Request-ID: req-39ca4b24-2f25-4038-89d1-5649c0e217d4) Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:23.441982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:23.442911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a0241d85-8d8e-4581-9411-fb8b77525c33 could not be found. Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 17 20:21:23.443913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a0241d85-8d8e-4581-9411-fb8b77525c33 could not be found. Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a0241d85-8d8e-4581-9411-fb8b77525c33 could not be found. Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cec6b267-76ea-4d6b-a47e-7eee2b12e335 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Returning 404 to user: Snapshot a0241d85-8d8e-4581-9411-fb8b77525c33 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:23.444862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cec6b267-76ea-4d6b-a47e-7eee2b12e335 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33" status: 404 len: 111 microversion: 2.1 time: 0.192427 Aug 17 20:21:23.447377 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 14/21] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:21:23 2022] GET /compute/v2.1/os-snapshots/a0241d85-8d8e-4581-9411-fb8b77525c33 => generated 111 bytes in 199 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:21:23.460725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a9d0ce93-45a7-46d0-b5d0-592d5ac3aba8 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b54040>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:23.666946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-328991625", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "networks": [{"uuid": "398b9172-7a19-491c-86c3-bb47b8afa103"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:23.883929 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a9d0ce93-45a7-46d0-b5d0-592d5ac3aba8 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb" status: 202 len: 0 microversion: 2.1 time: 0.435428 Aug 17 20:21:23.888718 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 15/22] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:21:23 2022] DELETE /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb => generated 0 bytes in 441 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:21:23.900888 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f90e28ab-6d6a-45f9-b666-0802e3fdbb40 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b54790>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:24.068296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] validate_networks() for [('398b9172-7a19-491c-86c3-bb47b8afa103', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:21:24.136452 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f90e28ab-6d6a-45f9-b666-0802e3fdbb40 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb" status: 200 len: 345 microversion: 2.1 time: 0.245321 Aug 17 20:21:24.143063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 16/23] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:23 2022] GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb => generated 345 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:25.156094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-16f178f9-0e5f-46b8-aba0-604bcf5ac0e2 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b4b700>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:25.222080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-16f178f9-0e5f-46b8-aba0-604bcf5ac0e2 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] HTTP exception thrown: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-16f178f9-0e5f-46b8-aba0-604bcf5ac0e2 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Request method failure captured: Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb HTTP/1.1 Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U21BJgReRpPqbIcFLYWwBO5PZQbwm7U-Bt0DHJHducXv_QuFjkd1HvqdIwzvcDVTYW_vLKjlkL4lAMAa-w0EPLg4THp9rhSm4gnEFppLR1-k97K2Gh8Zm1nnljvJrwcSG6gMZz10g5yqc7BdZQE6saBgNQOh8gJ_b1-0eZuhxRmSJA Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:25.232695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: c339948fd8e64dd0afeaddbe8c5eb533 Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '61881e51-974c-41c9-b0ff-e9d493e7e7cb'} Aug 17 20:21:25.234050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. (HTTP 404) (Request-ID: req-fb741b20-e445-4a64-9a08-8b07e30fdf74) Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.234852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:25.235901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:21:25.236951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-16f178f9-0e5f-46b8-aba0-604bcf5ac0e2 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Returning 404 to user: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-16f178f9-0e5f-46b8-aba0-604bcf5ac0e2 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb" status: 404 len: 109 microversion: 2.1 time: 0.083267 Aug 17 20:21:25.238515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 17/24] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:25 2022] GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:21:25.248767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b7aac22e-f693-485b-ad7f-65c68b32b885 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b543a0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:25.316382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-b7aac22e-f693-485b-ad7f-65c68b32b885 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] HTTP exception thrown: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b7aac22e-f693-485b-ad7f-65c68b32b885 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Request method failure captured: Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb HTTP/1.1 Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U21BJgReRpPqbIcFLYWwBO5PZQbwm7U-Bt0DHJHducXv_QuFjkd1HvqdIwzvcDVTYW_vLKjlkL4lAMAa-w0EPLg4THp9rhSm4gnEFppLR1-k97K2Gh8Zm1nnljvJrwcSG6gMZz10g5yqc7BdZQE6saBgNQOh8gJ_b1-0eZuhxRmSJA Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:25.318796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: c339948fd8e64dd0afeaddbe8c5eb533 Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '61881e51-974c-41c9-b0ff-e9d493e7e7cb'} Aug 17 20:21:25.320223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. (HTTP 404) (Request-ID: req-53e8d013-4e59-4ec2-a570-ae8159811d0f) Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.321123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 17 20:21:25.322295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 17 20:21:25.324324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.325649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.327695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b7aac22e-f693-485b-ad7f-65c68b32b885 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Returning 404 to user: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:25.329052 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b7aac22e-f693-485b-ad7f-65c68b32b885 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb" status: 404 len: 109 microversion: 2.1 time: 0.087444 Aug 17 20:21:25.330146 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 18/25] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:21:25 2022] DELETE /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:21:25.350298 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9287ad0c-79a1-4179-9e85-63f6b4dad211 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Calling method '.version_select at 0x7f23e3b543a0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:25.461408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-9287ad0c-79a1-4179-9e85-63f6b4dad211 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] HTTP exception thrown: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9287ad0c-79a1-4179-9e85-63f6b4dad211 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Request method failure captured: Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb HTTP/1.1 Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U21BJgReRpPqbIcFLYWwBO5PZQbwm7U-Bt0DHJHducXv_QuFjkd1HvqdIwzvcDVTYW_vLKjlkL4lAMAa-w0EPLg4THp9rhSm4gnEFppLR1-k97K2Gh8Zm1nnljvJrwcSG6gMZz10g5yqc7BdZQE6saBgNQOh8gJ_b1-0eZuhxRmSJA Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:21:25.464440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5ee573df90244e76a7ff255a0d8d88ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 5ee573df90244e76a7ff255a0d8d88ef Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1710880919 Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: c339948fd8e64dd0afeaddbe8c5eb533 Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1710880919-project Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '61881e51-974c-41c9-b0ff-e9d493e7e7cb'} Aug 17 20:21:25.469485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. (HTTP 404) (Request-ID: req-f6bbeb5a-a4ea-431c-a6a6-6784f8a33c58) Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.470110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:21:25.471202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:21:25.472183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9287ad0c-79a1-4179-9e85-63f6b4dad211 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] Returning 404 to user: Volume 61881e51-974c-41c9-b0ff-e9d493e7e7cb could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9287ad0c-79a1-4179-9e85-63f6b4dad211 tempest-VolumesSnapshotsTestJSON-1710880919 tempest-VolumesSnapshotsTestJSON-1710880919-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb" status: 404 len: 109 microversion: 2.1 time: 0.131439 Aug 17 20:21:25.473118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 19/26] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:25 2022] GET /compute/v2.1/os-volumes/61881e51-974c-41c9-b0ff-e9d493e7e7cb => generated 109 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:21:26.891156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:21:26.891992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:21:26.892172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:21:26.893118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:21:26.893404 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:21:26.916550 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:26.917266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:26.917938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:26.919151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:26.919778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:26.920366 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:26.977653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Getting quotas for project 64b460fadf7a4e248f29bf520316bf1a. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:21:26.983727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Getting quotas for user b9e5a2de79e64520a471abc3540d1922 and project 64b460fadf7a4e248f29bf520316bf1a. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:21:26.998709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:21:27.001490 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:21:27.271828 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-47784ef4-cd47-49b2-8161-32b88a679c1f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.474766 Aug 17 20:21:27.279838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 8/27] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:21:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 4476 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:21:27.287434 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-39b2d841-7dcd-450d-85a9-fe3af6cf6837 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:27.288355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-39b2d841-7dcd-450d-85a9-fe3af6cf6837 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:27.605805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-39b2d841-7dcd-450d-85a9-fe3af6cf6837 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:27.639752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-39b2d841-7dcd-450d-85a9-fe3af6cf6837 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1214 microversion: 2.1 time: 0.353836 Aug 17 20:21:27.641626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 9/28] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:27 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1214 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:28.146216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f8af13a0-fafc-4ae6-963c-8a477a4755c2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'create', calling method: .version_select at 0x7f23e3b54670>, body: {"keypair": {"name": "tempest-keypair-272915331", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOsMiNCxjdpruf5ySUnCJyfOi24KG/GedM2xrZGN5KEZMduNri1VhUWRQ40mIfMGF2E380FKtBeuV1/VNxTPhv8b6KVFrYhJhe2URWk22cD0ZEDynIh+OrxiGxqMoozq4g=="}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:28.313413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-f8af13a0-fafc-4ae6-963c-8a477a4755c2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for project f95e63e2fad24821953b5549e26f9dbd. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:21:28.353168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-f8af13a0-fafc-4ae6-963c-8a477a4755c2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for user acd37d5161b247139f337ef0bf50a764 and project f95e63e2fad24821953b5549e26f9dbd. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:21:28.676017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f8af13a0-fafc-4ae6-963c-8a477a4755c2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.446071 Aug 17 20:21:28.679304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 20/29] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:21:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1450 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:21:28.702128 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6ae4676c-f47b-43f9-b25f-f34fdd0d4615 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:28.703559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6ae4676c-f47b-43f9-b25f-f34fdd0d4615 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:28.890130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6ae4676c-f47b-43f9-b25f-f34fdd0d4615 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:28.906398 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6ae4676c-f47b-43f9-b25f-f34fdd0d4615 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1214 microversion: 2.1 time: 0.225134 Aug 17 20:21:28.907331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 10/30] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:28 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:29.934023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c349cd31-10b0-45b5-8004-2c8107054897 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:29.937513 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c349cd31-10b0-45b5-8004-2c8107054897 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:30.038918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c349cd31-10b0-45b5-8004-2c8107054897 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:30.084940 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c349cd31-10b0-45b5-8004-2c8107054897 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1214 microversion: 2.1 time: 0.156300 Aug 17 20:21:30.085555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 21/31] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:29 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1214 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:30.538203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-307304504", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:30.737299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] validate_networks() for [('441ba4d2-e313-49f3-a4c3-91dec2076ac7', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:21:31.118200 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0d16fbd0-4443-4836-92e5-abe0e3949cfc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:31.127643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0d16fbd0-4443-4836-92e5-abe0e3949cfc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:31.327141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0d16fbd0-4443-4836-92e5-abe0e3949cfc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:31.344599 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0d16fbd0-4443-4836-92e5-abe0e3949cfc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1214 microversion: 2.1 time: 0.237978 Aug 17 20:21:31.347804 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 22/32] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:31 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1214 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:32.185200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:21:32.186276 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:21:32.186975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:21:32.188127 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:21:32.188947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:21:32.222082 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:32.235083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:32.236470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:32.239374 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:32.240142 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:32.242116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:32.305200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:21:32.333849 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for user 8cacffb3524f4f8ea97946e5e4af1ac3 and project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:21:32.377961 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:32.380673 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:32.384361 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:21:32.386708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:21:32.418237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:32.423714 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:32.441368 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:32.451820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:32.455212 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:32.456572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:32.681408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4cc09801-498d-45cb-8ba7-25491e08b13c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.498917 Aug 17 20:21:32.683839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 11/33] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:21:30 2022] POST /compute/v2.1/servers => generated 383 bytes in 2504 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:21:32.702397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dda17d0c-e904-4f9d-bb66-20fc426b4d9b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:32.703201 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dda17d0c-e904-4f9d-bb66-20fc426b4d9b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:32.916899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dda17d0c-e904-4f9d-bb66-20fc426b4d9b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:32.926910 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dda17d0c-e904-4f9d-bb66-20fc426b4d9b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1221 microversion: 2.1 time: 0.231337 Aug 17 20:21:32.936290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 12/34] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:32 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1221 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:33.210551 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:33.247475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c80ba2ca-1920-4326-958b-0029caf25222 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1210 microversion: 2.1 time: 0.880136 Aug 17 20:21:33.251609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 23/35] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:32 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1210 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:33.410002 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-137141126", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:33.539132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] validate_networks() for [('441ba4d2-e313-49f3-a4c3-91dec2076ac7', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:21:34.298150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:34.299658 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:34.320604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:34.325970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:34.327451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:34.332096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:34.332703 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:34.333157 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:34.507467 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:34.520303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f2ab024f-57a6-48bc-bcaf-fca7b08fed50 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1266 microversion: 2.1 time: 0.226728 Aug 17 20:21:34.538402 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 24/36] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:34 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1266 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:34.977956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:21:34.978574 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:21:34.981148 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:21:34.981807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:21:34.982503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:21:35.012871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:35.014832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:35.015474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:35.017333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:35.019110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:35.021138 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:35.076630 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:21:35.091267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for user 8cacffb3524f4f8ea97946e5e4af1ac3 and project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:21:35.097010 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:21:35.099667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:21:35.300249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5330c599-cce7-472b-a155-9f23b949c938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.903325 Aug 17 20:21:35.301172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 13/37] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:21:33 2022] POST /compute/v2.1/servers => generated 383 bytes in 1907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:21:35.322411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-63d64fca-25c3-45a0-a421-bb8851ecb8bb tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:35.322411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-63d64fca-25c3-45a0-a421-bb8851ecb8bb tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:35.529214 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1330060357", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e44abbe6-3735-455d-be24-2acc87eb2370"}], "security_groups": [{"name": "tempest-securitygroup--1649887346"}], "key_name": "tempest-keypair-272915331", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:35.736582 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-63d64fca-25c3-45a0-a421-bb8851ecb8bb tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:35.802040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-63d64fca-25c3-45a0-a421-bb8851ecb8bb tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1221 microversion: 2.1 time: 0.473142 Aug 17 20:21:35.840616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 25/38] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:35 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1221 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:35.869017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:35.878933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:35.949630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:35.958795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:35.964380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:35.969634 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:35.975952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:35.979570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:36.363128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:36.441570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] validate_networks() for [('e44abbe6-3735-455d-be24-2acc87eb2370', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:21:36.442464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9750b0ac-954d-4ef7-93e4-61b92808dbf1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1272 microversion: 2.1 time: 0.588936 Aug 17 20:21:36.449628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 26/39] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:35 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1272 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:36.838598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-72bd8e30-116b-44fb-80d8-b78131a2d5b2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:36.842819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-72bd8e30-116b-44fb-80d8-b78131a2d5b2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:37.080777 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-72bd8e30-116b-44fb-80d8-b78131a2d5b2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:37.093236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-72bd8e30-116b-44fb-80d8-b78131a2d5b2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1221 microversion: 2.1 time: 0.259499 Aug 17 20:21:37.112424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 27/40] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:36 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1221 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:37.487445 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:37.495474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:37.567224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:37.568357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:37.569020 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:37.574512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:37.575984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:37.586581 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:37.889802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:37.933724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ba362727-959c-43c2-b2ac-2565b7af73b1 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1272 microversion: 2.1 time: 0.466270 Aug 17 20:21:37.968262 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 28/41] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:37 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1272 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:38.094365 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:21:38.095837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:21:38.099823 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:21:38.101146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:21:38.111960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:21:38.127310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:38.128217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:38.156954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:38.157862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:38.159384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:38.165267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:38.171105 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:38.172995 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:38.174186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:38.177241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:38.179197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:38.182378 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:38.186812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:38.187637 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:38.327267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for project f95e63e2fad24821953b5549e26f9dbd. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:21:38.346085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for user acd37d5161b247139f337ef0bf50a764 and project f95e63e2fad24821953b5549e26f9dbd. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:21:38.439926 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:21:38.456144 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:21:38.464872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:38.491949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2aa383ed-1907-43aa-b967-4c341be51bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1225 microversion: 2.1 time: 0.369637 Aug 17 20:21:38.511647 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 29/42] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:38 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1225 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:38.902306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0cee8083-74b2-40f5-a52e-bbd38e780f34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.377846 Aug 17 20:21:38.927142 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 14/43] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:21:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 3401 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:21:38.927861 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-34aef2e3-bf82-416d-af41-6939ed776e1c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:38.928719 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-34aef2e3-bf82-416d-af41-6939ed776e1c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:39.005111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:39.012997 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:39.061759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:39.076012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:39.077226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:39.078596 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:39.089901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:39.103515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:39.455712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-34aef2e3-bf82-416d-af41-6939ed776e1c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:39.479518 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-34aef2e3-bf82-416d-af41-6939ed776e1c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1237 microversion: 2.1 time: 0.552129 Aug 17 20:21:39.497283 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 30/44] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:38 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1237 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:39.553187 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:39.555588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:39.577955 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:39.580796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:39.581854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:39.587943 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:39.614548 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:39.615595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:40.103989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:40.103989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0c12d6e8-a705-4761-b6be-513152f4d730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1273 microversion: 2.1 time: 0.342047 Aug 17 20:21:40.103989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 31/45] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:39 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1273 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:40.103989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3420319c-17a1-4a32-80c1-8425bfdefeac tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e31b15e0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:40.105994 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:40.128397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fbc4fc78-736f-47f8-b5a0-62820af70a28 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 1.136228 Aug 17 20:21:40.130157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 15/46] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:38 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:40.529889 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0173386b-f902-4a36-bb62-f8331ed4f1dd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:40.530610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0173386b-f902-4a36-bb62-f8331ed4f1dd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:40.649985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0173386b-f902-4a36-bb62-f8331ed4f1dd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:40.663489 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0173386b-f902-4a36-bb62-f8331ed4f1dd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1237 microversion: 2.1 time: 0.137765 Aug 17 20:21:40.673674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 16/47] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:40 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1237 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:40.777286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3420319c-17a1-4a32-80c1-8425bfdefeac tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/14e6b8c8-59c2-4069-87ff-ab41b57628e3" status: 200 len: 350 microversion: 2.1 time: 0.870723 Aug 17 20:21:40.779100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 32/48] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:39 2022] GET /compute/v2.1/os-volumes/14e6b8c8-59c2-4069-87ff-ab41b57628e3 => generated 350 bytes in 875 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:40.912463 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:40.913146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:40.929733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:40.929733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:40.929733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:40.931135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:40.931485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:40.933658 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:41.042504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:41.066715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c1fc2648-de86-48da-9560-f775ae6d37a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1281 microversion: 2.1 time: 0.160338 Aug 17 20:21:41.067917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 17/49] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:40 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1281 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:41.173309 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:41.177321 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:41.194311 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:41.196375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:41.197537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:41.199526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:41.201504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:41.202424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:41.699515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-26847d4c-b7ff-4153-b0b1-d3364640c173 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:41.700453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-26847d4c-b7ff-4153-b0b1-d3364640c173 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:42.053016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-26847d4c-b7ff-4153-b0b1-d3364640c173 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:42.094875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-26847d4c-b7ff-4153-b0b1-d3364640c173 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1237 microversion: 2.1 time: 0.391874 Aug 17 20:21:42.103493 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 18/50] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:41 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1237 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:42.126499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:42.128448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:42.145193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:42.147040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:42.148438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:42.151609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:42.153982 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:42.155605 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:42.266292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:42.285266 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d5e4fd64-f4c2-4d39-b93e-13e84f73c50a tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 1.120638 Aug 17 20:21:42.294863 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 33/51] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:41 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 1131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:42.473659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:42.493126 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0e839da2-330a-4bab-a405-2695abd72f3e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1291 microversion: 2.1 time: 0.382911 Aug 17 20:21:42.508864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 19/52] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:42 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1291 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:43.131974 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:43.132971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:43.153662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:43.154506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:43.155220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:43.158396 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:43.158396 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:43.161788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:43.305901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:43.306542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:43.328604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:43.329166 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:43.329664 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:43.330412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:43.330936 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:43.331409 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:43.431464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:43.458003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c0209dd9-8429-4800-b053-9f552cb081d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1241 microversion: 2.1 time: 0.330833 Aug 17 20:21:43.466482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 34/53] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:43 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1241 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:43.546170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:43.548389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:43.570313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:43.571676 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:43.573071 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:43.575286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:43.577675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:43.578797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:44.156477 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:44.173511 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-03dc5b4a-a248-44c4-ae65-797da65d6207 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1279 microversion: 2.1 time: 0.658295 Aug 17 20:21:44.184828 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 35/54] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:43 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1279 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:44.207947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:44.220243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a594c423-19c2-4115-b6cd-9b792cc8219e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.918429 Aug 17 20:21:44.221669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 20/55] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:43 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:44.509688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:44.511387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:44.524426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:44.531276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:44.536111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:44.536111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:44.536111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:44.536111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:44.691732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-62e24ebc-bca8-44cb-8e71-1782e60024d0 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e29deee0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:44.720718 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:44.742901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-39c6cd0f-c046-4bb0-a1f2-a6a99e61e55f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1289 microversion: 2.1 time: 0.238290 Aug 17 20:21:44.750804 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 36/56] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:44 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1289 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:45.214012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:45.214903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:45.224896 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:45.229604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:45.234744 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:45.237339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:45.239023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:45.240764 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:45.503694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-62e24ebc-bca8-44cb-8e71-1782e60024d0 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/6439b308-ad91-45f8-91ba-4c0ad244c650" status: 200 len: 350 microversion: 2.1 time: 0.815943 Aug 17 20:21:45.505012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 21/57] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:44 2022] GET /compute/v2.1/os-volumes/6439b308-ad91-45f8-91ba-4c0ad244c650 => generated 350 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:21:45.511225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:45.511977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:45.552708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:45.553155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:45.554652 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:45.558228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:45.558228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:45.559383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:46.353485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:46.404762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1d9a8a62-113b-49f8-88c4-6f00de4aa171 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 1.193503 Aug 17 20:21:46.410745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 37/58] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:45 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:46.431690 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:46.439862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:46.474924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:46.483214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:46.491334 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:46.493583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:46.494460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:46.501120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:47.322447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:47.332532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5a7e61fa-9e87-4a8a-9200-247ff96ad4a0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1295 microversion: 2.1 time: 0.919855 Aug 17 20:21:47.333734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 38/59] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:46 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1295 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:47.387858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:47.422119 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-739fb7df-7033-4987-8c99-2bfee782e0cd tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 1.912576 Aug 17 20:21:47.422837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 22/60] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:45 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 1917 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:47.756813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-e664d642-37fe-424a-9e35-2c62b46b3441 req-ea2e7669-8534-4a6b-b967-f8e45df8261e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32d5e6ed-1020-4330-84a4-379f4213b4e1", "tag": "ca2defd7-8c8d-4a95-ab78-3354618308eb"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:47.792603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e664d642-37fe-424a-9e35-2c62b46b3441 req-ea2e7669-8534-4a6b-b967-f8e45df8261e service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:47.792859 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e664d642-37fe-424a-9e35-2c62b46b3441 req-ea2e7669-8534-4a6b-b967-f8e45df8261e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:47.795606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e664d642-37fe-424a-9e35-2c62b46b3441 req-ea2e7669-8534-4a6b-b967-f8e45df8261e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:47.834598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-e664d642-37fe-424a-9e35-2c62b46b3441 req-ea2e7669-8534-4a6b-b967-f8e45df8261e service nova] Creating event network-changed:ca2defd7-8c8d-4a95-ab78-3354618308eb for instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 on hv-cinder-83538 Aug 17 20:21:47.835466 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e664d642-37fe-424a-9e35-2c62b46b3441 req-ea2e7669-8534-4a6b-b967-f8e45df8261e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 20:21:47.836014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e664d642-37fe-424a-9e35-2c62b46b3441 req-ea2e7669-8534-4a6b-b967-f8e45df8261e service nova] Acquired lock "compute-rpcapi-router" {{(pid=121275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 20:21:47.837297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:47.838325 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:47.838983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:47.839945 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:47.841537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:47.842153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:47.852976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.compute.rpcapi [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 20:21:47.854126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] Releasing lock "compute-rpcapi-router" {{(pid=121275) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 20:21:47.889019 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cad5ca37-bbf4-4434-86ce-aa1dd7fd77b5 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.552176 Aug 17 20:21:47.894500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 39/61] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:47.905632 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:47.906937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:47.932274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:47.938128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:47.939690 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:47.941255 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:47.959525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:47.959525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:47.998797 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-44968540-4b8f-4fb9-9885-0a04b7a672c2 req-ab756c3f-4048-4f05-8c5f-5ec6d91be874 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "52e647f8-55ce-495b-9377-720c285dac92", "tag": "2d62a4b7-f472-4b11-9a65-5c868716a5f3"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:48.039208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-44968540-4b8f-4fb9-9885-0a04b7a672c2 req-ab756c3f-4048-4f05-8c5f-5ec6d91be874 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:48.042292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-44968540-4b8f-4fb9-9885-0a04b7a672c2 req-ab756c3f-4048-4f05-8c5f-5ec6d91be874 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:48.044327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-44968540-4b8f-4fb9-9885-0a04b7a672c2 req-ab756c3f-4048-4f05-8c5f-5ec6d91be874 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:48.078006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-44968540-4b8f-4fb9-9885-0a04b7a672c2 req-ab756c3f-4048-4f05-8c5f-5ec6d91be874 service nova] Creating event network-changed:2d62a4b7-f472-4b11-9a65-5c868716a5f3 for instance 52e647f8-55ce-495b-9377-720c285dac92 on hv-cinder-83538 Aug 17 20:21:48.079049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-44968540-4b8f-4fb9-9885-0a04b7a672c2 req-ab756c3f-4048-4f05-8c5f-5ec6d91be874 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 17 20:21:48.079642 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-44968540-4b8f-4fb9-9885-0a04b7a672c2 req-ab756c3f-4048-4f05-8c5f-5ec6d91be874 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 17 20:21:48.081043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:48.082043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:48.082833 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:48.084170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:48.085455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:48.097287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:48.109852 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.compute.rpcapi [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Aug 17 20:21:48.111149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] Releasing lock "compute-rpcapi-router" {{(pid=121276) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 17 20:21:48.146846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bb556c0c-41a6-48c3-be98-c316fd6b7159 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.721019 Aug 17 20:21:48.148368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 23/62] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:21:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:48.374249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:48.379989 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:48.392299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=12 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:48.397564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:48.398739 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:48.399255 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:48.400293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:48.400959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:48.401579 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:48.538355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:48.560465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4988cba5-c896-48ff-bd58-f2b5cfcaecc2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.668104 Aug 17 20:21:48.587515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 40/63] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:47 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:48.599522 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:48.604430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-79b67d06-bca6-4e77-943c-98e2acc1d45a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1295 microversion: 2.1 time: 0.243711 Aug 17 20:21:48.605516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 24/64] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:48 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1295 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:48.611382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:48.612774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:48.625098 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:48.628119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:48.628119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:48.628949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:48.630235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:48.631287 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:48.994300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ad1420d7-841f-4b1f-87b7-73862b2b6a08 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e29c1790>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:49.072330 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ad1420d7-841f-4b1f-87b7-73862b2b6a08 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/0c6eb5dc-5a98-43a3-a38d-6fd06d32306e" status: 200 len: 351 microversion: 2.1 time: 0.082010 Aug 17 20:21:49.073923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 25/65] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:21:48 2022] GET /compute/v2.1/os-volumes/0c6eb5dc-5a98-43a3-a38d-6fd06d32306e => generated 351 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:49.095058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a4f54189-852e-4153-adf1-e95e861848e3 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e29c1310>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:49.425753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a4f54189-852e-4153-adf1-e95e861848e3 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.341908 Aug 17 20:21:49.428172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 26/66] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Aug 17 20:21:49 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:49.472369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dbbc8f33-cb98-46aa-bed0-b4681ca13dd9 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e2a149d0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:49.475944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=14 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:49.709096 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dbbc8f33-cb98-46aa-bed0-b4681ca13dd9 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.269994 Aug 17 20:21:49.709784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 27/67] 10.222.0.64 () {58 vars in 1149 bytes} [Wed Aug 17 20:21:49 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:49.715797 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:49.717474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:49.738466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:49.740111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:49.744799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:49.750526 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:49.750526 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:49.756241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:49.870021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:49.904786 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6e563c91-ff7e-49d8-ad4a-f706b06c8110 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 1.315274 Aug 17 20:21:49.925901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 41/68] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:48 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 1338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:49.931608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:49.948966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:49.956938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:49.958002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:49.959014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:49.960638 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:49.961514 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:49.962184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:50.794237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:50.804213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=53 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:50.821272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-35b57db7-c338-47b7-8f0e-fc0900f5c2d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 1.095838 Aug 17 20:21:50.821272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 28/69] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:49 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:50.821272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f0194eb1-451a-4e22-9b0f-057317e2474c tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e29c14c0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:51.076838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f0194eb1-451a-4e22-9b0f-057317e2474c tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.261737 Aug 17 20:21:51.093543 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 29/70] 10.222.0.64 () {58 vars in 1134 bytes} [Wed Aug 17 20:21:50 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:51.101499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:51.102760 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:51.119557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:51.120840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:51.122120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:51.126744 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:51.129295 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:51.131487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:51.479629 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:51.520656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ec7cd4d0-6ce1-4be4-adb7-ec1dfe91adcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 1.587307 Aug 17 20:21:51.522350 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 42/71] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:49 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 1595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:51.580322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-17691ec2-2ec7-4dd4-9c87-b6b5009729b9 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e3186670>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:51.943975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-17691ec2-2ec7-4dd4-9c87-b6b5009729b9 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.399261 Aug 17 20:21:51.956375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 43/72] 10.222.0.64 () {58 vars in 1167 bytes} [Wed Aug 17 20:21:51 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:51.988216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-df8571d8-c27c-469e-9340-c9765227165e req-fbade612-ab22-43b6-895a-5d07c313c5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c075d32a-1481-4f49-948f-89929c655ebc", "tag": "9b0a1441-cd79-4f90-8cbf-babd2da616ff"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:52.009736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:52.028872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-df8571d8-c27c-469e-9340-c9765227165e req-fbade612-ab22-43b6-895a-5d07c313c5b1 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:52.032527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-df8571d8-c27c-469e-9340-c9765227165e req-fbade612-ab22-43b6-895a-5d07c313c5b1 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:52.034789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-df8571d8-c27c-469e-9340-c9765227165e req-fbade612-ab22-43b6-895a-5d07c313c5b1 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:52.050953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-df8571d8-c27c-469e-9340-c9765227165e req-fbade612-ab22-43b6-895a-5d07c313c5b1 service nova] Creating event network-changed:9b0a1441-cd79-4f90-8cbf-babd2da616ff for instance c075d32a-1481-4f49-948f-89929c655ebc on hv-cinder-83538 Aug 17 20:21:52.064025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-df8571d8-c27c-469e-9340-c9765227165e req-fbade612-ab22-43b6-895a-5d07c313c5b1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101604 Aug 17 20:21:52.071572 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=34 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:52.088199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 44/73] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:21:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:52.094162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:52.097980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:52.114162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:52.117530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:52.118270 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:52.127743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:52.128787 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:52.129661 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:52.160192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:52.709157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:52.727823 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9b4c7af5-78b0-417c-959d-d7277d6ed038 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 1.646602 Aug 17 20:21:52.729755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 30/74] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:51 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 1651 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:52.744341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7c57a376-a302-428a-ac0a-491b8297b060 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e29c1310>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:52.859036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:52.875922 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d6a6aef0-05cc-4f1d-b645-49adb42a3465 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.785326 Aug 17 20:21:52.893168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 45/75] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:52 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:52.917983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:52.919149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:52.926996 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7c57a376-a302-428a-ac0a-491b8297b060 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.192208 Aug 17 20:21:52.928465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 31/76] 10.222.0.64 () {58 vars in 1170 bytes} [Wed Aug 17 20:21:52 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:52.943327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:52.944352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:52.945570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:52.948267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:52.949136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:52.950457 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:52.968698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-d3f8bd36-a63c-4f2c-9cff-9f12abfdcb1c req-bf91fbd5-a4a7-40f3-87c9-f31de1267f39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f848de82-5bd1-4bf9-b720-8a8fac4ea7cd", "tag": "8aa64187-8b77-488f-ada3-4985b564cf73"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:21:53.016479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d3f8bd36-a63c-4f2c-9cff-9f12abfdcb1c req-bf91fbd5-a4a7-40f3-87c9-f31de1267f39 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:53.017330 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d3f8bd36-a63c-4f2c-9cff-9f12abfdcb1c req-bf91fbd5-a4a7-40f3-87c9-f31de1267f39 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:53.018090 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d3f8bd36-a63c-4f2c-9cff-9f12abfdcb1c req-bf91fbd5-a4a7-40f3-87c9-f31de1267f39 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:53.053947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-d3f8bd36-a63c-4f2c-9cff-9f12abfdcb1c req-bf91fbd5-a4a7-40f3-87c9-f31de1267f39 service nova] Creating event network-changed:8aa64187-8b77-488f-ada3-4985b564cf73 for instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd on hv-cinder-83538 Aug 17 20:21:53.068804 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-d3f8bd36-a63c-4f2c-9cff-9f12abfdcb1c req-bf91fbd5-a4a7-40f3-87c9-f31de1267f39 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.136784 Aug 17 20:21:53.071999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 32/77] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:53.087974 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca4439f0-687c-4da1-848f-973fc44ec8b9 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e2a8b3a0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:53.236788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:53.250228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0ea961d8-e461-4ba0-88fa-f988d74a03a5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.354734 Aug 17 20:21:53.251628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 46/78] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:52 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:53.402674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ca4439f0-687c-4da1-848f-973fc44ec8b9 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.326674 Aug 17 20:21:53.403657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 33/79] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Aug 17 20:21:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:53.421523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e41c3d31-2780-4a03-9c76-0411095b7ee1 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e31865e0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:53.699952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e41c3d31-2780-4a03-9c76-0411095b7ee1 tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.286348 Aug 17 20:21:53.700939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 47/80] 10.222.0.64 () {58 vars in 1188 bytes} [Wed Aug 17 20:21:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:21:53.719088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4574a571-62c3-424f-af7b-6527ab60a49a tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] Calling method '.version_select at 0x7f23e29c1dc0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:53.777105 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:53.779337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:53.791250 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:53.792425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:53.793800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:53.795666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:53.797443 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:53.798313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:53.825516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4574a571-62c3-424f-af7b-6527ab60a49a tempest-VolumesTestJSON-809568598 tempest-VolumesTestJSON-809568598-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.112883 Aug 17 20:21:53.826598 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 34/81] 10.222.0.64 () {58 vars in 1155 bytes} [Wed Aug 17 20:21:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:53.921081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:53.922124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:53.960877 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:53.961692 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:53.966289 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:53.970055 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:53.971610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:53.972163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:54.266078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:54.274405 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dcf11384-d706-401d-82c3-1b2b05d8a36f tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.506811 Aug 17 20:21:54.275801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 48/82] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:53 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:54.285967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:54.287063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:54.294340 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:54.295237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:54.295951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:54.296909 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:54.297743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:54.298358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:54.319269 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:54.351259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-99a7eb31-01d2-486e-b32e-bdf5ba951bd1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.434096 Aug 17 20:21:54.354111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 35/83] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:53 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:54.569196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:54.581774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5890c9f1-2891-4761-92aa-44bc84805efc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.299793 Aug 17 20:21:54.582367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 49/84] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:54 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:55.337948 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:55.340211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:55.365440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:55.366020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:55.368222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:55.369753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:55.370684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:55.374279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:55.381365 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:55.382952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:55.416240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:55.417690 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:55.421802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:55.424797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:55.428128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:55.429195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:56.020086 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:56.037050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8d4c6db4-3f30-4708-a4fd-6460bc0e6e03 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.722969 Aug 17 20:21:56.038455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 36/85] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:55 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:56.053086 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:56.054210 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:56.069828 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:56.070959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:56.071619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:56.072751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:56.073454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:56.076670 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:56.102911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:56.125471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e98b7364-1513-4979-8836-14e7124b6aa6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.751814 Aug 17 20:21:56.136393 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 50/86] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:55 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:56.408598 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:56.423552 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dff36721-0490-472a-bee4-d5e1d88a4c30 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.383456 Aug 17 20:21:56.424329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 37/87] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:56 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:57.087494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:57.087494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:57.098930 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:57.099805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:57.100576 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:57.101954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:57.102811 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:57.103651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:57.173113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:57.176450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:57.191182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:57.199522 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:57.210343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:57.210343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:57.210343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:57.211249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:57.511090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:57.538506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5a5a12c2-6f52-4183-b2da-9ca73c8cc347 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.459560 Aug 17 20:21:57.550063 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:57.567407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 51/88] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:57 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:57.570263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a769a203-99ec-468e-ace2-b5a138a75d31 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.406579 Aug 17 20:21:57.572018 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 38/89] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:57 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:21:57.588846 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:57.591096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:57.606810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:57.606810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:57.606810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:57.608919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:57.610292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:57.611332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:57.848835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:57.885829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:57.894998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f0997136-72b5-451f-b3de-d27e880ab276 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.325996 Aug 17 20:21:57.895675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 52/90] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:57 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:58.594911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:58.596955 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:58.598864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:58.599920 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:58.609784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=10 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:21:58.612234 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:58.613085 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:58.613847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:58.614550 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:58.615164 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:58.615992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:58.616698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:58.617002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:58.618093 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:58.619897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:58.622850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:58.630621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:59.499097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:59.512058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3e60c28a-5d51-4617-8d04-a301bd4c0fee tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.925762 Aug 17 20:21:59.513899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 39/91] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:58 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:59.524763 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:21:59.525407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:59.526614 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:21:59.539090 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:59.540284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:59.540860 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:59.542059 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:21:59.542697 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:21:59.544853 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:21:59.547937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dd9cf99b-1372-45ea-8429-559adb2397a6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.953750 Aug 17 20:21:59.549617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 53/92] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:58 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:21:59.865908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:21:59.888340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e7213b4e-de50-401a-b6ef-8ea50226ad53 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.370851 Aug 17 20:21:59.891086 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 40/93] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:21:59 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:00.226104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-9edf8fc1-8a1a-4d80-88cf-d27f9bc27dce req-ec142140-c4b9-4d4c-8336-e16c04c35d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d5e6ed-1020-4330-84a4-379f4213b4e1", "name": "network-vif-plugged", "status": "completed", "tag": "ca2defd7-8c8d-4a95-ab78-3354618308eb"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:00.240683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-9edf8fc1-8a1a-4d80-88cf-d27f9bc27dce req-ec142140-c4b9-4d4c-8336-e16c04c35d90 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:00.241533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-9edf8fc1-8a1a-4d80-88cf-d27f9bc27dce req-ec142140-c4b9-4d4c-8336-e16c04c35d90 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:00.242281 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-9edf8fc1-8a1a-4d80-88cf-d27f9bc27dce req-ec142140-c4b9-4d4c-8336-e16c04c35d90 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:00.259284 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-9edf8fc1-8a1a-4d80-88cf-d27f9bc27dce req-ec142140-c4b9-4d4c-8336-e16c04c35d90 service nova] Creating event network-vif-plugged:ca2defd7-8c8d-4a95-ab78-3354618308eb for instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 on hv-cinder-83538 Aug 17 20:22:00.266849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-9edf8fc1-8a1a-4d80-88cf-d27f9bc27dce req-ec142140-c4b9-4d4c-8336-e16c04c35d90 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.714781 Aug 17 20:22:00.268586 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 54/94] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:21:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:00.553997 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:00.554946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:00.563441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:00.564078 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:00.564743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:00.565805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:00.566419 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:00.566985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:00.588737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:00.593376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:00.608247 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:00.610107 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:00.615920 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:00.619183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:00.619671 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:00.620110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:01.219720 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:01.227939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:01.250888 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-75f6d253-793a-4761-8c6b-16989c50c7e0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.657191 Aug 17 20:22:01.250888 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 55/95] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:00 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 661 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:01.251466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b82b29c6-4c78-4c3d-bee2-7948b8bab2fc tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.696561 Aug 17 20:22:01.251466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 41/96] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:00 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:01.257520 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:01.259390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:01.274540 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:01.275071 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:01.275543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:01.276324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:01.276782 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:01.277609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:01.491666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:01.521310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d7527883-6f5d-47ca-b273-c29fa6ae6783 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.279427 Aug 17 20:22:01.523349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 56/97] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:01 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:02.267650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:02.268278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:02.279443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:02.280275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:02.282552 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:02.282748 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:02.283464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:02.284848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:02.288766 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:02.294256 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:02.299017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:02.299017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:02.301861 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:02.304217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:02.304726 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:02.305171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:02.627603 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:02.643410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-682b739a-6f84-4cd8-9362-7a8bb6c7849b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.379985 Aug 17 20:22:02.644200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 42/98] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:02 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:02.649075 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-cf03e286-af65-4e2b-82d4-1dbc9bedf879 req-54406506-a231-45b2-9c65-97b42780a35d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e647f8-55ce-495b-9377-720c285dac92", "name": "network-vif-plugged", "status": "completed", "tag": "2d62a4b7-f472-4b11-9a65-5c868716a5f3"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:02.659049 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:02.659854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cf03e286-af65-4e2b-82d4-1dbc9bedf879 req-54406506-a231-45b2-9c65-97b42780a35d service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:02.660502 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cf03e286-af65-4e2b-82d4-1dbc9bedf879 req-54406506-a231-45b2-9c65-97b42780a35d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:02.661330 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cf03e286-af65-4e2b-82d4-1dbc9bedf879 req-54406506-a231-45b2-9c65-97b42780a35d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:02.670296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d386113a-a01f-4c96-b5e7-9e6ff0f45020 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.394055 Aug 17 20:22:02.670901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 57/99] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:02 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:02.676946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:02.677954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:02.690422 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:02.690955 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:02.691395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:02.692239 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:02.692697 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:02.693279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:02.694083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-cf03e286-af65-4e2b-82d4-1dbc9bedf879 req-54406506-a231-45b2-9c65-97b42780a35d service nova] Creating event network-vif-plugged:2d62a4b7-f472-4b11-9a65-5c868716a5f3 for instance 52e647f8-55ce-495b-9377-720c285dac92 on hv-cinder-83538 Aug 17 20:22:02.704482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-cf03e286-af65-4e2b-82d4-1dbc9bedf879 req-54406506-a231-45b2-9c65-97b42780a35d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058855 Aug 17 20:22:02.705753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 43/100] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:02.931878 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:02.943942 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c0257cfa-4269-4dfd-a7de-aba5a429afcc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.271533 Aug 17 20:22:02.945065 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 58/101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:02 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:03.702921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:03.706494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:03.718122 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:03.719783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:03.723395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:03.725050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:03.726397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:03.726614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:03.727783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:03.729342 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:03.740151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:03.741508 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:03.742493 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:03.744245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:03.745804 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:03.748963 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:04.205102 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:04.214229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ce8cc9d6-ef8f-4f7e-bc44-1dfc655a7628 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1314 microversion: 2.1 time: 0.499741 Aug 17 20:22:04.230039 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 59/102] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:03 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:04.237375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:04.238454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:04.242876 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:04.245863 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:04.246662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:04.247292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:04.248451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:04.249412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:04.250207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:04.262810 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0927297d-5c7d-4fab-b915-f52dcb0d211d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.574760 Aug 17 20:22:04.265959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 44/103] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:03 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:04.485611 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:04.494224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5f1db458-033c-4ad4-8046-761f46963198 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.261333 Aug 17 20:22:04.495357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 60/104] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:04 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:04.730227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-81f15efc-a075-4d9b-91cc-53a499fd2288 req-81fa8fce-a8dc-4187-8c7d-c452b3db8027 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c075d32a-1481-4f49-948f-89929c655ebc", "name": "network-vif-plugged", "status": "completed", "tag": "9b0a1441-cd79-4f90-8cbf-babd2da616ff"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:04.744379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-81f15efc-a075-4d9b-91cc-53a499fd2288 req-81fa8fce-a8dc-4187-8c7d-c452b3db8027 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:04.745411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-81f15efc-a075-4d9b-91cc-53a499fd2288 req-81fa8fce-a8dc-4187-8c7d-c452b3db8027 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:04.745895 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-81f15efc-a075-4d9b-91cc-53a499fd2288 req-81fa8fce-a8dc-4187-8c7d-c452b3db8027 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:04.764057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-81f15efc-a075-4d9b-91cc-53a499fd2288 req-81fa8fce-a8dc-4187-8c7d-c452b3db8027 service nova] Creating event network-vif-plugged:9b0a1441-cd79-4f90-8cbf-babd2da616ff for instance c075d32a-1481-4f49-948f-89929c655ebc on hv-cinder-83538 Aug 17 20:22:04.768846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-81f15efc-a075-4d9b-91cc-53a499fd2288 req-81fa8fce-a8dc-4187-8c7d-c452b3db8027 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043895 Aug 17 20:22:04.770901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 45/105] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:22:05.241343 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:05.243881 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:05.257468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:05.258530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:05.259809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:05.263253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:05.264489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:05.265600 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:05.290400 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:05.292254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:05.318187 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:05.322819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:05.325758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:05.328666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:05.329168 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:05.329619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:05.905031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:05.913667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3e3c815c-2b72-4307-9207-bc5fc2251773 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1499 microversion: 2.1 time: 0.680016 Aug 17 20:22:05.915946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 61/106] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:05 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1499 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:05.919919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:05.920506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:05.931352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:05.932751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:05.935478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:05.941814 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:05.942700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:05.949599 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:05.979473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:05.990327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-94fbeca2-bbc6-42ac-a739-fd8e2037f2d1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.705867 Aug 17 20:22:05.991418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 46/107] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:05 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:06.238728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:06.252827 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a4988f7c-687b-43df-a611-4d6ed9de648b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.337340 Aug 17 20:22:06.253490 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 62/108] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:05 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:06.904344 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-d6788bc3-a670-41ab-b820-4fbaec276708 req-0edda3d1-78c6-4866-9bbb-bc88956a8af0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f848de82-5bd1-4bf9-b720-8a8fac4ea7cd", "name": "network-vif-plugged", "status": "completed", "tag": "8aa64187-8b77-488f-ada3-4985b564cf73"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:06.918576 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d6788bc3-a670-41ab-b820-4fbaec276708 req-0edda3d1-78c6-4866-9bbb-bc88956a8af0 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:06.919373 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d6788bc3-a670-41ab-b820-4fbaec276708 req-0edda3d1-78c6-4866-9bbb-bc88956a8af0 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:06.920049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d6788bc3-a670-41ab-b820-4fbaec276708 req-0edda3d1-78c6-4866-9bbb-bc88956a8af0 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:06.935751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-d6788bc3-a670-41ab-b820-4fbaec276708 req-0edda3d1-78c6-4866-9bbb-bc88956a8af0 service nova] Creating event network-vif-plugged:8aa64187-8b77-488f-ada3-4985b564cf73 for instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd on hv-cinder-83538 Aug 17 20:22:06.941593 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-d6788bc3-a670-41ab-b820-4fbaec276708 req-0edda3d1-78c6-4866-9bbb-bc88956a8af0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042883 Aug 17 20:22:06.942350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 47/109] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:07.017612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:07.018358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:07.029345 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:07.030166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:07.030992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:07.032332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:07.033180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:07.033958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:07.262821 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:07.267641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:07.272667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0d8a80b3-2fd2-4bdd-a556-e79bff53375f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.259801 Aug 17 20:22:07.273252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 63/110] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:07 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:07.292412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:07.293349 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:07.300832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:07.301406 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:07.301954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:07.302912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:07.303443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:07.303928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:07.509715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:07.520612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-05f7d8c4-dbe0-410e-9a2c-f51133158fb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.233087 Aug 17 20:22:07.521251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 48/111] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:07 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:08.297351 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:08.299148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:08.311074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:08.312507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:08.313705 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:08.315605 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:08.316855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:08.317911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:08.551137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:08.554293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:08.571156 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:08.578142 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:08.579450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:08.581785 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:08.583677 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:08.584807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:08.586820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:08.616489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c9961595-25e3-4d06-9054-9bc2cf007038 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1321 microversion: 2.1 time: 0.324416 Aug 17 20:22:08.617538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 64/112] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:08 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:08.892049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:08.903426 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3fcb4832-e7ef-497e-8b17-20b85a609899 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.360760 Aug 17 20:22:08.907421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 49/113] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:08 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:09.657950 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:09.659800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:09.670026 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:09.671120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:09.671845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:09.672884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:09.673466 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:09.674166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:09.909347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:09.927177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:09.929161 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:09.935739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3435beb7-d9ca-4f86-aa91-fc0f74edd4ba tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1515 microversion: 2.1 time: 0.284772 Aug 17 20:22:09.944407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 65/114] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:09 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1515 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:09.949848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:09.951115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:09.952469 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:09.954290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:09.955577 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:09.967423 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:09.981445 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:09.994473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:10.023444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:10.024516 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:10.027826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:10.027826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:10.030891 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:10.031439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:10.109849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'flavor' on Instance uuid c075d32a-1481-4f49-948f-89929c655ebc {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:22:10.223672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:10.269223 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3bd25c38-005e-40ff-a4f7-57af40f8364e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.339836 Aug 17 20:22:10.270439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 50/115] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:09 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:10.749103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6c7515c6-e7a5-4c17-b69d-31eeb26864cd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc/action" status: 200 len: 32 microversion: 2.1 time: 0.790629 Aug 17 20:22:10.749911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 66/116] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:22:09 2022] POST /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc/action => generated 32 bytes in 793 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 20:22:10.763241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:10.764491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:10.775334 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:10.776143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:10.777164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:10.788266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:10.788266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:10.788266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:10.991202 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:11.000867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a475c8d4-f4bb-4ac0-b6be-b5c4829c5dec tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.243810 Aug 17 20:22:11.001556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 51/117] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:10 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:11.329939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:11.332434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:11.346562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:11.347237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:11.347696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:11.348439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:11.353973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:11.353973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:11.646386 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:11.661819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a48d7513-5f78-483e-9167-d2a20839df9f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.350406 Aug 17 20:22:11.663167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 67/118] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:11 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:12.035424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:12.042340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:12.044528 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:12.045221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:12.045869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:12.047048 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:12.047892 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:12.048660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:12.057126 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:12.279364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:12.288029 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-617f3f79-4006-41bc-b03b-f54fdfcd5f0b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.256872 Aug 17 20:22:12.288740 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 52/119] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:12 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:12.540618 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d0e49fc2-3a6d-4407-a281-60db56211ea1"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:12.550016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:12.576646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:12.577672 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:12.578486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:12.579839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:12.580459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:12.581486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:12.697953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:12.699430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:12.713619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:12.715045 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:12.715711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:12.716849 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:12.717567 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:12.725339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:12.991415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:13.014319 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-50df68d0-45d0-412b-8495-79e0b34720ff tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.323011 Aug 17 20:22:13.016498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 53/120] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:12 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:13.312554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:13.313919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:13.320698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:13.321236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:13.325608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:13.325608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:13.325608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:13.325608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:13.536421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:13.550231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b37d66e2-3bf4-45f3-aa54-1d4bd0766ecf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.241920 Aug 17 20:22:13.551261 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 54/121] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:13 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:14.039929 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:14.041200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:14.054662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:14.054662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:14.054662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:14.054662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:14.055215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:14.055383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:14.241995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:14.252398 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-879bb144-1d37-4f43-a80c-3899491b17f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.218066 Aug 17 20:22:14.253323 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 55/122] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:14 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:14.575723 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:14.576778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:14.587065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:14.588438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:14.589438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:14.592251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:14.593310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:14.595084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:14.802376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:14.813411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-66abe291-62a2-4054-96d4-555bb331a2d5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.244075 Aug 17 20:22:14.814287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 56/123] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:14 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:15.281137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:15.284602 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:15.297715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:15.299185 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:15.308842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:15.308842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:15.308842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:15.308842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:15.589817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:15.609267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9d98a278-d532-4ea7-8c89-9920a60d8734 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1363 microversion: 2.1 time: 0.335562 Aug 17 20:22:15.626808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 57/124] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:15 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1363 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:15.854260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:15.856689 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:15.874672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:15.875565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:15.876419 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:15.878329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:15.880040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:15.880838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:16.149696 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:16.164416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7ee062ea-ddba-48fd-a195-0f9f298f52f7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.317667 Aug 17 20:22:16.167296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 58/125] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:15 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:16.478984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c7b410c5-6a4f-4b16-bada-fcae1265e7b2 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "POST /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.947525 Aug 17 20:22:16.480005 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 68/126] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:22:12 2022] POST /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1/os-volume_attachments => generated 194 bytes in 3950 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:16.672581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:16.677274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:16.698763 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:16.698763 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:16.699238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:16.700116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:16.702338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:16.703977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:17.194336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:17.196110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:17.209729 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:17.210911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:17.211822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:17.213093 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:17.214695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:17.215636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:17.382088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:17.402513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8d9437d3-0ea1-4ed1-b61f-0e21fea3e5f2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1550 microversion: 2.1 time: 0.738658 Aug 17 20:22:17.404371 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 59/127] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:16 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1550 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:17.425722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:17.426233 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:17.433286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:17.433787 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:17.434225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:17.434979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:17.435433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:17.435861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:17.507164 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:17.522459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-65a91e84-89c9-47e7-8685-57358ce3b7b8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.335552 Aug 17 20:22:17.524186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 69/128] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:17 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:17.649286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3d5aae6d-6b6c-4d16-a125-bed4ddd400ca tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.227381 Aug 17 20:22:17.650523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 60/129] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:22:17 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-interface => generated 285 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:22:18.560859 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:18.561591 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:18.568670 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:18.569124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:18.569557 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:18.570336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:18.570830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:18.571257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:18.771679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:18.781917 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8b8bdfcb-e97b-457c-b663-ae7514b2c82a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.225177 Aug 17 20:22:18.782731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 70/130] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:18 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:19.631470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-3fcfcfd8-ff61-4022-8a6d-74b509b2d2a8 req-7f914f03-b268-4b70-a401-0355f96f1b6b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f848de82-5bd1-4bf9-b720-8a8fac4ea7cd", "tag": "8aa64187-8b77-488f-ada3-4985b564cf73"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:19.647623 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-3fcfcfd8-ff61-4022-8a6d-74b509b2d2a8 req-7f914f03-b268-4b70-a401-0355f96f1b6b service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:19.648443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-3fcfcfd8-ff61-4022-8a6d-74b509b2d2a8 req-7f914f03-b268-4b70-a401-0355f96f1b6b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:19.649101 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-3fcfcfd8-ff61-4022-8a6d-74b509b2d2a8 req-7f914f03-b268-4b70-a401-0355f96f1b6b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:19.666952 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-3fcfcfd8-ff61-4022-8a6d-74b509b2d2a8 req-7f914f03-b268-4b70-a401-0355f96f1b6b service nova] Creating event network-changed:8aa64187-8b77-488f-ada3-4985b564cf73 for instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd on hv-cinder-83538 Aug 17 20:22:19.678657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-3fcfcfd8-ff61-4022-8a6d-74b509b2d2a8 req-7f914f03-b268-4b70-a401-0355f96f1b6b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051347 Aug 17 20:22:19.685529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 61/131] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:19.807217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:19.809276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:19.818151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:19.818498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:19.819764 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:19.823534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:19.823534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:19.823534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:20.024432 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:20.037824 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7286f1f6-9782-4ffc-abc7-9cad6c4b4e3b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.236523 Aug 17 20:22:20.039336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 71/132] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:19 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:21.077651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:21.081116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:21.101989 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:21.103044 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:21.103840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:21.105398 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:21.106351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:21.107432 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:21.414885 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:21.432058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ab7eeea3-1086-424f-9c6c-526cde491fea tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.363077 Aug 17 20:22:21.432698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 62/133] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:21 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:22.460145 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:22.461227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:22.474240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:22.475040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:22.475815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:22.477047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:22.477892 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:22.478671 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:22.699717 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:22.707897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8f6319f5-5a11-4555-9b0c-112875ccc9c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.254207 Aug 17 20:22:22.708894 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 72/134] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:22 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:23.732016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:23.732707 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:23.734869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=63 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:23.740000 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:23.740580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:23.741024 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:23.744084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:23.744651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:23.745752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:23.918824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:23.932434 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4a9a03d4-2fcb-4284-b7ac-38ba94f2b0a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.205027 Aug 17 20:22:23.933529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 63/135] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:23 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:24.956364 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:24.957607 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:24.964847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:24.965784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:24.966220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:24.967202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:24.967831 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:24.968918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:25.141167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:25.150319 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-be219174-8683-4016-9cd5-dc397777651e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.197793 Aug 17 20:22:25.151003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 73/136] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:24 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:26.171527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:26.172063 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:26.178749 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:26.179231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:26.179662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:26.180355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:26.180805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:26.181224 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:26.354251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:26.367157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e1bb16ef-afaa-443b-9473-c4574a406d09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.199303 Aug 17 20:22:26.378871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 64/137] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:26 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:27.391622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:27.392263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:27.394789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=58 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:27.399485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:27.399992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:27.400434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:27.401129 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:27.402179 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:27.402620 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:27.553152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:27.562386 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1a772cdc-b312-4835-8663-3805e36d4243 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.174495 Aug 17 20:22:27.563145 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 74/138] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:27 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:28.585546 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:28.586156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:28.592504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:28.593166 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:28.593764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:28.594969 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:28.595766 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:28.596386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:28.744912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:28.754027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-34fe4cae-9002-44ca-beb0-b9852c7b8e36 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.172041 Aug 17 20:22:28.754606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 65/139] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:28 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:29.777558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:29.778250 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:29.787442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:29.787939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:29.788905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:29.789616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:29.790116 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:29.790495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:29.965792 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:29.979497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e709cdb0-16c7-40eb-8b53-3238628392f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.207689 Aug 17 20:22:29.980083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 75/140] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:29 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:30.562894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:30.563455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:30.573715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:30.574417 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:30.574896 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:30.578424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:30.578424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:30.578424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:30.608125 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:22:31.016381 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:31.017243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:31.025025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:31.025675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:31.026236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:31.027535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:31.031528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:31.031528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:31.060846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6e2c0b3f-9e67-4363-8533-2ca1475b94e4 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "DELETE /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 204 len: 0 microversion: 2.1 time: 0.501764 Aug 17 20:22:31.061343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 66/141] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:22:30 2022] DELETE /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:22:31.072913 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:31.073829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:31.080890 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:31.081931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:31.082538 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:31.083548 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:31.084190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:31.084765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:31.356032 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:31.375847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bb748444-cb41-4358-87c2-96e81608cbe2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.361852 Aug 17 20:22:31.390710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 76/142] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:31 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:31.391160 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:31.402058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b4bd44d7-7f33-4f00-bb37-8783c592c972 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1551 microversion: 2.1 time: 0.334673 Aug 17 20:22:31.410184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 67/143] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:31 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1551 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:32.416285 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:32.417621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:32.424431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:32.424931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:32.425374 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:32.426141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:32.426679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:32.427295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:32.433472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:32.445259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:32.449067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:32.460390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:32.461501 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:32.462313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:32.463644 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:32.464933 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:32.465988 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:32.480084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:32.703032 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:32.713396 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b3428dc6-1ef2-45b0-9e82-abe66f1e0d68 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.300980 Aug 17 20:22:32.714237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 77/144] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:32 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:32.733917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:32.742585 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0ac301b0-057d-487a-b6ff-302a1c9df702 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1551 microversion: 2.1 time: 0.307801 Aug 17 20:22:32.743233 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 68/145] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:32 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1551 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:33.742482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:33.750808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:33.765236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:33.766067 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:33.766921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:33.768208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:33.769210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:33.769948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:33.783002 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:33.785503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:33.813147 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:33.817608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:33.818668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:33.820022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:33.824050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:33.824786 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:34.247706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:34.265339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:34.267708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-255abe7c-27ce-434c-b729-33033889b519 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1551 microversion: 2.1 time: 0.493369 Aug 17 20:22:34.269424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 69/146] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:33 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1551 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:34.273500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b6f2a9fb-72b2-4277-8f15-ba0f548f56d3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.540561 Aug 17 20:22:34.277621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 78/147] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:33 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:34.863223 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-0666e257-908e-4f9d-83be-696019c7ae94 req-31792bd0-b902-4e27-844d-594a832b0839 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32d5e6ed-1020-4330-84a4-379f4213b4e1", "name": "network-vif-deleted", "tag": "ca2defd7-8c8d-4a95-ab78-3354618308eb"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:34.873606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-0666e257-908e-4f9d-83be-696019c7ae94 req-31792bd0-b902-4e27-844d-594a832b0839 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:34.873997 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-0666e257-908e-4f9d-83be-696019c7ae94 req-31792bd0-b902-4e27-844d-594a832b0839 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:34.874434 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-0666e257-908e-4f9d-83be-696019c7ae94 req-31792bd0-b902-4e27-844d-594a832b0839 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:34.891100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-0666e257-908e-4f9d-83be-696019c7ae94 req-31792bd0-b902-4e27-844d-594a832b0839 service nova] Creating event network-vif-deleted:ca2defd7-8c8d-4a95-ab78-3354618308eb for instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 on hv-cinder-83538 Aug 17 20:22:34.897359 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-0666e257-908e-4f9d-83be-696019c7ae94 req-31792bd0-b902-4e27-844d-594a832b0839 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037770 Aug 17 20:22:34.905824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 70/148] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:22:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:22:35.300841 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:35.301388 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:35.301783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:35.302478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:35.308927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:35.309782 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:35.310377 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.311413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:35.311614 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:35.312092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:35.312538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.312664 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:35.313235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.313356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:35.314028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:35.314619 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:35.416498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:35.428844 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-58e3efe8-61a4-453a-8af8-c9d4fbc6696d tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1509 microversion: 2.1 time: 0.131872 Aug 17 20:22:35.429170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 71/149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:35 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1509 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:35.549155 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:35.564617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c85f3857-1d4b-449e-91e5-7c104f59a034 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.268203 Aug 17 20:22:35.565203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 79/150] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:35 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:36.453132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:36.453132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:36.462807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.462807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.462807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.462807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.464425 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.464425 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.538427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:36.547595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-46c96c36-7320-45b0-8743-e30e8c0243b9 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1509 microversion: 2.1 time: 0.101335 Aug 17 20:22:36.548186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 72/151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:36 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1509 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:36.592994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:36.593614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:36.601415 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.601909 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.602353 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.603098 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:36.603617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:36.604177 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:36.770074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:36.779945 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e11b92f4-fcdc-4125-b142-67a02fba8883 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.191049 Aug 17 20:22:36.780675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 80/152] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:36 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:37.587750 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:37.589482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:37.601062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.601947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.602830 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:37.604991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.605897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.606864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:37.680428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:37.696337 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-97115608-69c9-40e1-a159-02844f7f1c33 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1345 microversion: 2.1 time: 0.115156 Aug 17 20:22:37.697752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 73/153] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:37 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1345 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:37.816146 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:37.817367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:37.830924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.832069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.833152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:37.834467 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:37.835591 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:37.836618 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:38.013820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:38.027931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cbcc1ce4-e4a0-4362-8538-963f3a5dafe4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.219239 Aug 17 20:22:38.029887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 81/154] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:37 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:38.722812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:38.723879 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:38.748400 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:38.749293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:38.750089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:38.751444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:38.752414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:38.753184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:38.822501 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:38.828858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:38.828858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:38.828858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lazy-loading 'fault' on Instance uuid 32d5e6ed-1020-4330-84a4-379f4213b4e1 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:22:38.890981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9e5a2de79e64520a471abc3540d1922', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '64b460fadf7a4e248f29bf520316bf1a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:38.901683 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6f5b16f9-6df4-404f-9dd4-068d6bc0d127 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 200 len: 1350 microversion: 2.1 time: 0.185617 Aug 17 20:22:38.902375 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 74/155] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:38 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 1350 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:39.054991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:39.056060 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:39.067509 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:39.068698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:39.069706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:39.071563 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:39.073155 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:39.074784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:39.327645 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:39.336152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4fdd8a7a-2612-4194-b9b9-2ec3b0203213 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.288402 Aug 17 20:22:39.336847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 82/156] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:39 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:39.938874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:39.941367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:39.949621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:39.950580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:39.951191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:39.952181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:39.952938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:39.953631 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:39.977682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] HTTP exception thrown: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Request method failure captured: Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 HTTP/1.1 Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3CKUQnq64yfavWGgWPOZ23Ws-RrH3sWW7tLjeUe3G9UbPS56-UDgXsTxcMyuaZg3WGO7AVkSyuRzxHR1oCLQoBJ6ZigSvWAoOeRETB2LfpAUblnjSYJ7zXSc9u9wGtYpWwKJxfx09Ie-mO6pdeDnqBFkhqaHRLohfpH38KDhQ5bL8 Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:22:39.984964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: b9e5a2de79e64520a471abc3540d1922 Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:39.986157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '32d5e6ed-1020-4330-84a4-379f4213b4e1'} Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:22:39.986868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:39.987951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:39.990347 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Returning 404 to user: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:22:39.991497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0de40bfb-80a1-497e-bb93-1b6347df9744 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 404 len: 111 microversion: 2.1 time: 0.063508 Aug 17 20:22:39.992303 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 75/157] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:39 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:22:40.362481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:40.365902 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:40.373935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:40.374761 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:40.375684 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:40.376805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:40.377695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:40.378885 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:40.627876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:40.638375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-323ab492-b296-42f1-ac4b-67092fbd5ee1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.282073 Aug 17 20:22:40.639022 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 83/158] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:40 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:41.122968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:41.125466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:41.132818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:41.133423 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:41.133883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:41.134554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:41.141360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:41.141360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:41.154215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] HTTP exception thrown: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Request method failure captured: Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1/os-volume_attachments HTTP/1.1 Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3CKUQnq64yfavWGgWPOZ23Ws-RrH3sWW7tLjeUe3G9UbPS56-UDgXsTxcMyuaZg3WGO7AVkSyuRzxHR1oCLQoBJ6ZigSvWAoOeRETB2LfpAUblnjSYJ7zXSc9u9wGtYpWwKJxfx09Ie-mO6pdeDnqBFkhqaHRLohfpH38KDhQ5bL8 Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:22:41.155438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: b9e5a2de79e64520a471abc3540d1922 Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:41.157069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'server_id': '32d5e6ed-1020-4330-84a4-379f4213b4e1'} Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:22:41.157992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:41.160057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:41.161270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Returning 404 to user: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:22:41.161270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-58dfe401-73c9-4169-8541-b1fa4918402e tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042766 Aug 17 20:22:41.161270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 76/159] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:22:41 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:22:41.700509 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:41.703331 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:41.715714 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:41.716499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:41.717240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:41.718400 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:41.719198 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:41.719901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:41.895750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:41.901734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6fd5be47-1b02-4146-b4f9-cef5a260301d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.207862 Aug 17 20:22:41.902572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 84/160] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:41 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:42.925159 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:42.928764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:42.939517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:42.940487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:42.941540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:42.943476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:42.952361 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:42.953531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:43.181475 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:43.195277 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4bdd19db-cf75-45b6-9028-6f5abc90b350 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.274497 Aug 17 20:22:43.212300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 77/161] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:42 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:43.448299 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:43.449395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:43.466034 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:43.467430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:43.472243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:43.473326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:43.473883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:43.474389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:43.491719 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] HTTP exception thrown: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Request method failure captured: Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 HTTP/1.1 Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U3CKUQnq64yfavWGgWPOZ23Ws-RrH3sWW7tLjeUe3G9UbPS56-UDgXsTxcMyuaZg3WGO7AVkSyuRzxHR1oCLQoBJ6ZigSvWAoOeRETB2LfpAUblnjSYJ7zXSc9u9wGtYpWwKJxfx09Ie-mO6pdeDnqBFkhqaHRLohfpH38KDhQ5bL8 Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:22:43.497430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: b9e5a2de79e64520a471abc3540d1922 Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.500165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '32d5e6ed-1020-4330-84a4-379f4213b4e1'} Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:22:43.501424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.503855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.506380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Returning 404 to user: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:22:43.506380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-eae0bdb1-30d2-47d0-bb10-c232988cc4a0 tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "DELETE /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 404 len: 111 microversion: 2.1 time: 0.061542 Aug 17 20:22:43.506380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 85/162] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:22:43 2022] DELETE /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:22:43.513035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:43.513710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] [instance: 32d5e6ed-1020-4330-84a4-379f4213b4e1] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:43.520122 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:43.520608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:43.521035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:43.521896 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:43.522346 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:43.522971 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:43.545641 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] HTTP exception thrown: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Request method failure captured: Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 HTTP/1.1 Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3CKUQnq64yfavWGgWPOZ23Ws-RrH3sWW7tLjeUe3G9UbPS56-UDgXsTxcMyuaZg3WGO7AVkSyuRzxHR1oCLQoBJ6ZigSvWAoOeRETB2LfpAUblnjSYJ7zXSc9u9wGtYpWwKJxfx09Ie-mO6pdeDnqBFkhqaHRLohfpH38KDhQ5bL8 Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:22:43.547112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_64b460fadf7a4e248f29bf520316bf1a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 64b460fadf7a4e248f29bf520316bf1a Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-DeleteServersTestJSON-2137451479 Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: b9e5a2de79e64520a471abc3540d1922 Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-DeleteServersTestJSON-2137451479-project Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.548470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '32d5e6ed-1020-4330-84a4-379f4213b4e1'} Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:22:43.549225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. Aug 17 20:22:43.550428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:22:43.551452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] Returning 404 to user: Instance 32d5e6ed-1020-4330-84a4-379f4213b4e1 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:22:43.551452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d7bdd3d5-e86e-49ab-8d9f-eb33d33b41cf tempest-DeleteServersTestJSON-2137451479 tempest-DeleteServersTestJSON-2137451479-project] 10.222.0.64 "GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1" status: 404 len: 111 microversion: 2.1 time: 0.041568 Aug 17 20:22:43.551452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 78/163] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:43 2022] GET /compute/v2.1/servers/32d5e6ed-1020-4330-84a4-379f4213b4e1 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:22:44.242892 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:44.243627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:44.259236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:44.260211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:44.263151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:44.265991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:44.269694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:44.270877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:44.490142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:44.498659 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-af3a5d69-36bc-4005-85b4-695c59995a33 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.269535 Aug 17 20:22:44.499240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 86/164] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:44 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:45.532020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:45.536097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:45.554190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:45.555424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:45.556428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:45.559049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:45.560685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:45.561769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:45.786191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:45.796852 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6b035ec0-a1dc-4b79-b315-9346b9b820f4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.275599 Aug 17 20:22:45.797559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 79/165] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:45 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:46.821985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:46.822733 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:46.835204 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:46.835959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:46.847375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:46.848139 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:46.848617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:46.849044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:47.221392 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:47.231092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a4613c7a-2b86-4e2c-b5a3-86c660b6a8ef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.414484 Aug 17 20:22:47.235631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 87/166] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:46 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:48.264635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:48.268065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:48.287421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:48.288516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:48.289587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:48.292382 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:48.293910 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:48.309167 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:48.781837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:48.793631 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6727f26c-a847-435a-8aca-8f7f2f588787 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.537341 Aug 17 20:22:48.794540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 80/167] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:48 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:49.838245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:49.840147 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:49.849652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:49.849652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:49.849652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:49.850138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:49.850735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:49.851254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:50.325792 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:50.342695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bd423eba-31f4-41ee-aec3-01fd1ec5271c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1521 microversion: 2.1 time: 0.507599 Aug 17 20:22:50.376354 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 88/168] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:49 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1521 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:22:51.407935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:51.413278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:51.437586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:51.438795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:51.440953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:51.441848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:51.443761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:51.444312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:52.033903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:52.059038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b8b10585-8c5e-45e2-be23-13c468e76cce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1501 microversion: 2.1 time: 0.662265 Aug 17 20:22:52.080495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 81/169] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:51 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1501 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:52.093809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:52.094603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:52.102431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:52.102972 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:52.103420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:52.104187 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:52.104653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:52.112771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:52.672436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:52.699739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c32dfee5-c44b-4685-b463-7a379cd1afd3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1514 microversion: 2.1 time: 0.609499 Aug 17 20:22:52.703739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 89/170] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:52 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1514 bytes in 612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:56.122188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:22:56.124219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:56.136775 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:56.137264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:56.137733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:56.138446 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:56.139094 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:56.139673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:56.184197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'flavor' on Instance uuid 52e647f8-55ce-495b-9377-720c285dac92 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:22:56.725006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-99630809-bb30-4e0b-a4c5-44466cad6532 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92/action" status: 200 len: 32 microversion: 2.1 time: 0.613917 Aug 17 20:22:56.726059 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 82/171] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:22:56 2022] POST /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92/action => generated 32 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:22:56.738154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:56.739090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:56.757878 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:56.766459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:56.769321 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:56.771394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:56.774420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:56.775237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:57.077075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:57.098448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-104c6b82-40b3-4887-8563-e6de20c4ded5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.354380 Aug 17 20:22:57.098448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 90/172] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:56 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:58.126454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:58.145441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:58.145441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:22:58.157101 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:58.158094 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:58.158904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:58.159931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:58.160519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:58.161154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:58.369837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:58.386196 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d8ae954b-b8ea-4e08-a0b1-577b5bba0bf0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.268224 Aug 17 20:22:58.398660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 83/173] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:58 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:22:59.412542 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:22:59.424627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:22:59.424627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:59.429424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:59.429894 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:59.430694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:22:59.431294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:22:59.432628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:22:59.719285 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:22:59.758695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ee090d59-c327-4ffc-8c03-8c1278edc97f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.349503 Aug 17 20:22:59.763062 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 91/174] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:22:59 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:00.808175 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:00.808950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:00.824016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:00.825030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:00.825872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:00.830065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:00.830065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:00.830065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:01.205240 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:01.216502 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9e6674e6-10b0-455a-b16e-a10ff85d8a49 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.414876 Aug 17 20:23:01.219496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 84/175] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:00 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:02.247622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:02.259431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:02.289633 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=36 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:02.291443 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:02.293118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:02.298437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:02.299246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:02.299734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:02.300181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:02.818600 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:02.835129 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-794742d5-67b1-4205-869f-5535d6a2059e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.597360 Aug 17 20:23:02.835701 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 92/176] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:02 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:03.860196 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:03.861999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:03.881534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:03.883518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:03.890355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:03.891388 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:03.893293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:03.897284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:03.953386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:04.247229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:04.247229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2774cb8d-4f24-4fca-87a9-644089d4cf5f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.366978 Aug 17 20:23:04.247229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 85/177] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:03 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:04.698489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:04.699027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:04.713484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:04.713484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:04.713484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:04.713484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:04.713896 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:04.713896 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:04.749033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f8cd5451-baef-4326-984c-370ae7e803c5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/ips" status: 200 len: 145 microversion: 2.1 time: 0.058580 Aug 17 20:23:04.757133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 93/178] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:23:04 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/ips => generated 145 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:05.256193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:05.258964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:05.297455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:05.298119 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:05.298783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:05.299982 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:05.302309 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:05.303845 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:05.783555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:05.800617 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4004a9bf-74a6-40d4-b58a-74c5f67fa86f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.554841 Aug 17 20:23:05.830095 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 86/179] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:05 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:06.837169 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:06.837169 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:06.857764 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:06.861397 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.017s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:06.862244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:06.863472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:06.865784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:06.867059 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:06.875501 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=95 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:07.464497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:07.482338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c07cd50a-5200-412e-9a69-7ad483d59bb7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.651410 Aug 17 20:23:07.482968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 94/180] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:06 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:08.513106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:08.515667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:08.548924 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:08.552594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:08.556295 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:08.559014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:08.561118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:08.564726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:09.162916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:09.176363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a1ddbf13-a3ad-4c85-a477-0aa80919702b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.668286 Aug 17 20:23:09.179771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 87/181] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:08 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 674 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:10.083486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4320f67d-b1d0-49ba-9803-78e4ceca2a60"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:10.086347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:10.117311 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:10.120022 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:10.121607 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:10.122518 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:10.131326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:10.131958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:10.202781 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:10.203646 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:10.218331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:10.224501 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:10.227036 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:10.230326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:10.231052 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:10.231686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:10.741191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:10.772346 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-88e13d43-3237-4621-9ca6-fa41875c7227 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.572592 Aug 17 20:23:10.795045 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 88/182] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:10 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:11.804054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:11.804054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:11.826162 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:11.826686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:11.827124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:11.831028 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:11.839005 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:11.845776 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:12.385718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:12.400668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f9bbfec8-bef2-4a5a-86ce-1bca5c561730 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.605449 Aug 17 20:23:12.406788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 89/183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:11 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:13.011260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-05fc53f2-ad83-40ed-a6ab-99658ddb95fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'create', calling method: .version_select at 0x7f23e277ea60>, body: {"keypair": {"name": "tempest-keypair-779561908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA31rRKZOOlx8+eQoPH1sZdTsdbSk2pthoEx+PO9L7AOZHjjT+xOyh9lSYVrkJKntR+M+8bnZXBW/X5YVER9Z67UGNvk8KdFzj6iRWm/q1di5u78gQyttz9sEKrS/JXzQw=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:13.068731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-05fc53f2-ad83-40ed-a6ab-99658ddb95fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for project 7052604e37f4405bb5ccf8ffff694369. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:13.075350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-05fc53f2-ad83-40ed-a6ab-99658ddb95fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for user 3355014e725048949595575341c69c9c and project 7052604e37f4405bb5ccf8ffff694369. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:13.254144 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-05fc53f2-ad83-40ed-a6ab-99658ddb95fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.481782 Aug 17 20:23:13.255492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 90/184] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Aug 17 20:23:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 484 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 20:23:13.424637 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:13.425272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:13.439163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:13.442417 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:13.443517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:13.444545 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:13.446640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:13.452207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:13.918407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:13.954323 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7440a897-4195-410a-befb-7bf4dce7f44a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.509148 Aug 17 20:23:13.954323 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 91/185] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:13 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:14.293519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-10e6187a-4972-489d-ad1b-5acfe0b33574 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.213020 Aug 17 20:23:14.303112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 95/186] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:23:10 2022] POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-volume_attachments => generated 194 bytes in 4220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:14.972752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:14.973629 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:14.987183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:14.987958 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:14.988424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:14.991212 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:14.993414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:14.996623 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:15.293121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:15.311426 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d8110ffc-682c-448d-97cc-8fab628e2f3f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.353288 Aug 17 20:23:15.327806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 92/187] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:14 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:15.998655 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-909bb7a0-e50e-43ab-a456-f0950649d8a9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Action: 'create', calling method: .version_select at 0x7f23e1ec53a0>, body: {"keypair": {"name": "tempest-TestShelveInstance-546023720", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFuwvvNiWQt0t0Q5ap6gYNdutIT+v22UH3NpGDYYRK8r14pcIPuZ20ZsCGDVHPaPJi+tEll+Obv4cV5OBLFenwDNAFLJcQJfR93aXsQ8wvdu7HOUXY8rnsFIDHXmak7KSg=="}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:16.020087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-909bb7a0-e50e-43ab-a456-f0950649d8a9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Getting quotas for project 1291a3f047aa40278c9d3d048abc194e. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:16.026833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-909bb7a0-e50e-43ab-a456-f0950649d8a9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Getting quotas for user cfa791db71dd4345ba4b5988a33ec533 and project 1291a3f047aa40278c9d3d048abc194e. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:16.277402 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-909bb7a0-e50e-43ab-a456-f0950649d8a9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.657123 Aug 17 20:23:16.291504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 96/188] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:23:15 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:16.347903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:16.348956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:16.364511 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:16.365984 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:16.366814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:16.369943 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:16.374117 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:16.375262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:16.915997 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:16.927466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2be3a0bb-e959-4f99-b02e-c61a4a79b73a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.583590 Aug 17 20:23:16.941943 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 93/189] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:16 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:17.979507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:17.981214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:18.006434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:18.007071 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:18.007722 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:18.008901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:18.016035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:18.016755 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:18.978649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:18.996540 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f3a64731-e4e4-4240-bfe9-5aa1110d344b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 1.035150 Aug 17 20:23:18.998948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 97/190] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:17 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:20.037268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:20.038477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:20.078270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:20.078270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:20.078270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:20.078270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:20.078906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:20.079672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:20.652133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-110784952", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b5a2268-95a7-4ac8-b93b-e80001b58f38"}], "security_groups": [{"name": "tempest-securitygroup--1632573305"}], "key_name": "tempest-keypair-779561908", "user_data": "}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:20.892525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:20.947329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0016b8da-c8a4-47d9-b98c-dd45ecec8091 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.917370 Aug 17 20:23:21.018251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 94/191] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:20 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 990 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:21.636241 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] validate_networks() for [('9b5a2268-95a7-4ac8-b93b-e80001b58f38', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:23:21.997582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:21.999923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:22.036659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:22.038029 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:22.041696 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:22.048499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:22.049868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:22.058288 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:23.037635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:23.090424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=4 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:23.120874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4f784e41-5d9a-420a-94bd-9daa35e68d48 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 1.131725 Aug 17 20:23:23.127378 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 95/192] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:21 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 1139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:24.168282 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:24.169369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:24.175302 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:23:24.176224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:23:24.177018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:23:24.177766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:23:24.178521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:23:24.213123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:24.213979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:24.216410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:24.219014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:24.221864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:24.227258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:24.238201 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:24.247108 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:24.248221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:24.249735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:24.253904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:24.255077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:24.342936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for project 7052604e37f4405bb5ccf8ffff694369. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:24.355872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for user 3355014e725048949595575341c69c9c and project 7052604e37f4405bb5ccf8ffff694369. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:24.383030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:23:24.387224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:23:24.727327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:24.751077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5ede641d-73f4-4844-8fe3-c2135392955b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 4.116123 Aug 17 20:23:24.753963 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 98/193] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Aug 17 20:23:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 4120 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 20:23:24.767657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-19e44627-cded-4484-a175-47805cb1103f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1500 microversion: 2.1 time: 0.607440 Aug 17 20:23:24.768659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 96/194] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:24 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1500 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:24.779683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5a6564d8-64f1-4bc2-96a7-84a5203531bf tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:24.781154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5a6564d8-64f1-4bc2-96a7-84a5203531bf tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:24.802253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "94e91465-7450-4776-9392-aebb6183045f"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:24.805482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:24.821161 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:24.822068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:24.823013 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:24.823957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:24.825227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:24.826326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:24.865163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] HTTP exception thrown: Cannot 'attach_volume' instance 52e647f8-55ce-495b-9377-720c285dac92 while it is in vm_state rescued Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Request method failure captured: Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: POST /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92/os-volume_attachments HTTP/1.1 Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 74 Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3Jr6kMmDyuEpMJkIuma3ay9uir9vZ6UI1eyehWoPf6Q27Z8GCZQaywFzJAj-0OF6VyVRBvRf6gVZS8NQkxX2oXcrwXCW0ucrAENIMw3PQ3fKQGRge7pnJpRaUb6pb01_Ys7HIrcCKauhQR4FGK7TuZmSWdSLJiUac7zEyBWXWrOZ8 Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:23:24.868273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 8cacffb3524f4f8ea97946e5e4af1ac3 Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {"volumeAttachment": {"volumeId": "94e91465-7450-4776-9392-aebb6183045f"}} Aug 17 20:23:24.869592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Cannot 'attach_volume' instance 52e647f8-55ce-495b-9377-720c285dac92 while it is in vm_state rescued Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'server_id': '52e647f8-55ce-495b-9377-720c285dac92', 'body': {'volumeAttachment': {'volumeId': '94e91465-7450-4776-9392-aebb6183045f'}}} Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 52e647f8-55ce-495b-9377-720c285dac92 in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:23:24.870264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 52e647f8-55ce-495b-9377-720c285dac92 while it is in vm_state rescued Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:23:24.871684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:23:24.872669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:23:24.872669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:23:24.872669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 52e647f8-55ce-495b-9377-720c285dac92 while it is in vm_state rescued Aug 17 20:23:24.872669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:23:24.912499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Returning 409 to user: Cannot 'attach_volume' instance 52e647f8-55ce-495b-9377-720c285dac92 while it is in vm_state rescued {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:23:24.912864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-64798692-0486-4e98-ba86-826c2e92e3a5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.120216 Aug 17 20:23:24.931183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 97/195] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:23:24 2022] POST /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92/os-volume_attachments => generated 152 bytes in 138 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Aug 17 20:23:24.949206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:24.952984 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:24.986338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:24.995150 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:24.998551 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:24.999806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:25.011245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:25.016541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:25.028854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a6564d8-64f1-4bc2-96a7-84a5203531bf tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:25.043181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a6564d8-64f1-4bc2-96a7-84a5203531bf tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:25.048230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a6564d8-64f1-4bc2-96a7-84a5203531bf tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:25.053497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5a6564d8-64f1-4bc2-96a7-84a5203531bf tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1280 microversion: 2.20 time: 0.286488 Aug 17 20:23:25.060504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 99/196] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:24 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1280 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:23:25.635737 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a2fa9cb7-c41d-4834-bd89-5b3308b41e2e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92/action" status: 202 len: 0 microversion: 2.1 time: 0.696833 Aug 17 20:23:25.640917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 98/197] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:23:24 2022] POST /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92/action => generated 0 bytes in 707 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:23:25.648249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:25.649066 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:25.683423 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:25.692830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:25.693338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:25.694106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:25.701811 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:25.702976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:26.115486 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fddc3786-926b-45c7-acfc-77dafbfed39f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:26.119361 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fddc3786-926b-45c7-acfc-77dafbfed39f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:26.608917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fddc3786-926b-45c7-acfc-77dafbfed39f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:26.614181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:26.636160 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fddc3786-926b-45c7-acfc-77dafbfed39f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:26.642859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fddc3786-926b-45c7-acfc-77dafbfed39f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:26.652709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fddc3786-926b-45c7-acfc-77dafbfed39f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1280 microversion: 2.20 time: 0.542140 Aug 17 20:23:26.654798 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ac832384-d5cd-4079-a684-7cdeb56a4b14 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1508 microversion: 2.1 time: 1.010421 Aug 17 20:23:26.657176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 99/198] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:26 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1280 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:23:26.660462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 100/199] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:25 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1508 bytes in 1017 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:26.702308 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bb81e93f-73fd-42a0-9402-2e9a073f3d19 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:26.740716 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb81e93f-73fd-42a0-9402-2e9a073f3d19 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:26.744240 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb81e93f-73fd-42a0-9402-2e9a073f3d19 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:26.748254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bb81e93f-73fd-42a0-9402-2e9a073f3d19 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:26.960410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bb81e93f-73fd-42a0-9402-2e9a073f3d19 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Going to try to stop instance {{(pid=121276) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 20:23:27.269125 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bb81e93f-73fd-42a0-9402-2e9a073f3d19 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action" status: 202 len: 0 microversion: 2.1 time: 0.601377 Aug 17 20:23:27.275517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 100/200] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:23:26 2022] POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action => generated 0 bytes in 618 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:23:27.289111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:27.291078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:27.309887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:27.311416 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:27.312158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:27.313527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:27.314249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:27.314971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:27.698486 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:27.699928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:27.742326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:27.743971 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:27.748344 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:27.754251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:27.758339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:27.761374 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:28.116978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:28.164843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e55fc7bd-5785-42df-be41-c721e8aaacb9 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.879610 Aug 17 20:23:28.167111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 101/201] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:27 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 883 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:28.191665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:28.195238 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:28.220481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:28.221969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:28.223021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:28.224587 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:28.225968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:28.227032 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:28.246851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:28.282064 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:28.290590 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:28.296427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-77efb453-d36e-4a83-afb8-996f507b111a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1284 microversion: 2.20 time: 0.612312 Aug 17 20:23:28.315809 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 101/202] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:27 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1284 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:28.921367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:28.933511 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-51aee715-bbd6-47a5-8734-7e8615114718 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1508 microversion: 2.1 time: 0.762643 Aug 17 20:23:28.935021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 102/203] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:28 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1508 bytes in 767 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:29.229986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:29.230840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:29.243747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:29.245010 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:29.245667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:29.246672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:29.247699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:29.248313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:29.258685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:29.357096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:29.358474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:29.373315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:29.379474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:29.379474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:29.380707 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:29.381485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:29.382236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:29.730834 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:29.754563 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:29.767731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:29.776045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1c281e8f-1d3c-4f56-bffe-f72a6ab0e60c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1332 microversion: 2.20 time: 0.431577 Aug 17 20:23:29.777295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 103/204] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:29 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1332 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:29.869786 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:29.881026 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ca5ad5dc-48be-46ff-a2eb-8ef06238423f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.681385 Aug 17 20:23:29.907960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 102/205] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:29 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 693 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:29.987876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:29.992850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:30.010369 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.011876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.013002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:30.015865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.017121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.018177 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:30.333602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:30.346435 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d4372c94-3ddd-4b32-8796-3111d5a81c15 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1508 microversion: 2.1 time: 0.372175 Aug 17 20:23:30.347210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 104/206] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:29 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1508 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:30.848487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:30.849587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:30.881724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.882431 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.898977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:30.898977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.898977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.898977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:30.923042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:30.923883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:30.952471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.953018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.953312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:30.954139 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:30.954477 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:30.965453 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:31.083390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:31.136307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:31.151928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:31.155114 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a7f4b106-6af9-4d93-85fb-110e7cf30a19 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1332 microversion: 2.20 time: 0.336871 Aug 17 20:23:31.160594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 103/207] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:30 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1332 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:31.329097 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:31.344741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-58a1f9a8-be9a-43f9-9eec-4177239ed98f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.431970 Aug 17 20:23:31.346538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 105/208] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:30 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:31.400915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:31.411467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:31.444610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:31.446875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:31.459122 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:31.460379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:31.461156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:31.462348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:31.904932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:31.955408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-17ce9b1c-a1b0-4ebc-b4f8-7e19cb8c4425 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1514 microversion: 2.1 time: 0.547316 Aug 17 20:23:31.971919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 104/209] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:31 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1514 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:32.182941 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:32.184157 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:32.195333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:32.204035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:32.206679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:32.207659 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:32.211575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:32.214942 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:32.355746 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:32.370969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:32.372884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:32.378217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-152adb56-ae56-45ef-b603-b2e8da8ad252 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1350 microversion: 2.20 time: 0.199256 Aug 17 20:23:32.379606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 106/210] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:32 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1350 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:32.393658 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:32.394292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:32.429278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:32.433899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:32.434445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:32.436106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:32.437577 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:32.439898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:32.651477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:32.661386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e64fcd9e-9b80-4101-9cd8-15854d182423 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.272973 Aug 17 20:23:32.677102 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 105/211] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:32 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:33.407252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:33.408049 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:33.425903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:33.426771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:33.427736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:33.431243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:33.431243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:33.431243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:33.686499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:33.688367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:33.701680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:33.707461 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:33.709351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:33.711650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:33.712477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:33.717633 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:33.937805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:33.969171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:33.975823 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:33.983811 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d948dae5-2855-4ff9-97ff-19a788a7f9b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.581812 Aug 17 20:23:33.986003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 107/212] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:33 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:34.051850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dadd21e7-180e-47f3-92b5-3fd075bf38fe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'create', calling method: .version_select at 0x7f23e1ebe280>, body: {"keypair": {"name": "tempest-keypair-807852595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCtYg5NrxqONq/laarvL64lO9oItGC/J1HB0WWMobUNm7EmEDKJf8a49X3aaF5OktRGFrYCGu0SVmeY2IvJy6okC8AorSFa/GTPZrYFo4UCsdZVT4d4mnINDKir8PokJRQ=="}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:34.082801 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:34.092159 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-eb30536f-e0d7-4028-b872-9d1e0336ceac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.410315 Aug 17 20:23:34.097294 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 106/213] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:33 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:34.112429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-dadd21e7-180e-47f3-92b5-3fd075bf38fe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:34.135141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-dadd21e7-180e-47f3-92b5-3fd075bf38fe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for user 8cacffb3524f4f8ea97946e5e4af1ac3 and project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:34.299158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dadd21e7-180e-47f3-92b5-3fd075bf38fe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.259370 Aug 17 20:23:34.306201 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 108/214] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:23:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:35.023358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:35.025872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:35.050229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:35.053170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:35.053834 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:35.054463 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:35.055480 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:35.056111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:35.056786 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:35.299860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:35.299860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:35.299860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:35.299860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=5 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:35.299860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:35.303886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:35.303886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:35.303886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:35.303886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:35.304836 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:35.563081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:35.583501 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:35.587616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:35.588854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-249ad9aa-1197-41b8-b0b1-adbb6b8dbd57 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.581969 Aug 17 20:23:35.598274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:35.614749 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 107/215] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:35 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:35.635966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f76a621e-394a-4c5d-bc92-5c86e438feed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.511758 Aug 17 20:23:35.640055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 109/216] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:35 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:36.617189 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:36.620022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:36.637132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:36.643901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:36.646215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:36.658447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:36.659773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:36.661113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:36.661894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:36.662381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:36.675978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:36.677313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:36.682044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:36.683073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:36.686907 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:36.688481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:36.695213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:37.353016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:37.382301 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:37.387816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:37.391258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0535b920-e7cf-4b94-a09d-6c2ed497152b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.775882 Aug 17 20:23:37.402154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 108/217] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:36 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:37.414211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-d5128024-5156-4da5-8143-41227b04f5c0 req-61b0349c-ac1a-4345-a0d7-7ed117436f30 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43150116-1ad7-4a0c-b292-98ee4307770d", "tag": "450fc8d5-29fd-4e49-8e9e-caca2f42f264"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:37.442149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d5128024-5156-4da5-8143-41227b04f5c0 req-61b0349c-ac1a-4345-a0d7-7ed117436f30 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:37.443525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d5128024-5156-4da5-8143-41227b04f5c0 req-61b0349c-ac1a-4345-a0d7-7ed117436f30 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:37.451295 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d5128024-5156-4da5-8143-41227b04f5c0 req-61b0349c-ac1a-4345-a0d7-7ed117436f30 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:37.475706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-d5128024-5156-4da5-8143-41227b04f5c0 req-61b0349c-ac1a-4345-a0d7-7ed117436f30 service nova] Creating event network-changed:450fc8d5-29fd-4e49-8e9e-caca2f42f264 for instance 43150116-1ad7-4a0c-b292-98ee4307770d on hv-cinder-83538 Aug 17 20:23:37.484726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-d5128024-5156-4da5-8143-41227b04f5c0 req-61b0349c-ac1a-4345-a0d7-7ed117436f30 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078957 Aug 17 20:23:37.493702 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 109/218] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:37.516642 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:37.530486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1d0fef7b-2bf2-4509-a4b5-88de8182a24a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.876892 Aug 17 20:23:37.543445 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 110/219] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:36 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:38.419243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:38.421294 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:38.428806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:38.429774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:38.432819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:38.434045 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:38.435000 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:38.435811 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:38.557756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:38.559707 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:38.580646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:38.580646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:38.580646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:38.580646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:38.581119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:38.581119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:39.189338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:39.226849 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:39.229432 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:39.237741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d64f1be2-5eda-4d71-9d2b-dd6a5bf522f1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.818651 Aug 17 20:23:39.239960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:39.257070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 110/220] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:38 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:39.276572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-55d453bc-3c76-47a3-8cf5-eb6085d892d8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.721915 Aug 17 20:23:39.276572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 111/221] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:38 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:40.051451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1182156182", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:40.140632 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] validate_networks() for None {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:23:40.315191 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:40.320454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:40.351218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.352050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.353419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.354835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.355662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.356440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.375294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:40.661253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:23:40.661691 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:23:40.662308 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:23:40.662580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:23:40.663025 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:23:40.667796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:40.674757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.675234 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.675679 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.676429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.677120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.677671 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.679426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:40.681892 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:40.683968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-20e4b77d-878b-41fc-8ccb-4c43531d7df3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.394421 Aug 17 20:23:40.684866 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 112/222] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:40 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:23:40.690563 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:40.691467 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:40.699003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.699505 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.700000 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.700712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:40.701170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:40.701686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:40.717004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Getting quotas for project 5f0c454fc4f14e7cb33582566d510164. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:40.722908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Getting quotas for user 70aa263746b248508aa2c4f844c56d40 and project 5f0c454fc4f14e7cb33582566d510164. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:40.735600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:23:40.737923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:23:40.870195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:40.884793 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9cb38131-5e90-48c1-87bd-4a041bcd447c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.197961 Aug 17 20:23:40.885725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 113/223] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:40 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:41.011973 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-504fe608-9fc9-4216-a313-68db6113b02d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.964708 Aug 17 20:23:41.023761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 111/224] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:23:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 973 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:23:41.031426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0f1c3cd8-8e2f-4c80-99af-e3349437f743 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:41.032711 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0f1c3cd8-8e2f-4c80-99af-e3349437f743 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:41.121673 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0f1c3cd8-8e2f-4c80-99af-e3349437f743 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:41.124460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=17 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:41.134524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0f1c3cd8-8e2f-4c80-99af-e3349437f743 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1215 microversion: 2.1 time: 0.106390 Aug 17 20:23:41.162680 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 114/225] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:41 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1215 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:41.251911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1572872007", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "441ba4d2-e313-49f3-a4c3-91dec2076ac7"}], "security_groups": [{"name": "tempest-securitygroup--508496559"}], "key_name": "tempest-keypair-807852595", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:41.458857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] validate_networks() for [('441ba4d2-e313-49f3-a4c3-91dec2076ac7', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:23:41.714001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:41.715231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:41.749423 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:41.753330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:41.754134 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:41.756312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:41.761040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:41.761672 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:42.111213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:42.157712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:42.169574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:42.171368 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6c87930d-88c9-4dc7-8103-67c82154613b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.462853 Aug 17 20:23:42.179653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 115/226] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:41 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:23:42.220698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:42.225582 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:42.257084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:42.261766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:42.264257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:42.268038 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:42.269885 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:42.274199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:42.617137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:23:42.618246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:23:42.618773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:23:42.619192 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:23:42.619601 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:23:42.657324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:42.667487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:42.678539 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:42.698840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:42.711984 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:42.713555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:42.733909 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:42.751899 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5d399007-37eb-49bb-8ec6-f07a83130ea5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.567743 Aug 17 20:23:42.768960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 116/227] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:42 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:42.776340 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e1d736da-2e47-4f10-9e2e-6312477679be tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:42.777617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e1d736da-2e47-4f10-9e2e-6312477679be tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:42.803364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:42.821657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Getting quotas for user 8cacffb3524f4f8ea97946e5e4af1ac3 and project 489cb30d561c4b6591f8cf6fb74e1ee3. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:42.870312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:23:42.874408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:23:42.896483 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e1d736da-2e47-4f10-9e2e-6312477679be tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:42.908759 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e1d736da-2e47-4f10-9e2e-6312477679be tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1215 microversion: 2.1 time: 0.137241 Aug 17 20:23:42.910372 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 117/228] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:42 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1215 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:43.171083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e031f215-cabc-4983-b3f5-84c7e8622a05 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.926162 Aug 17 20:23:43.172033 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 112/229] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:23:41 2022] POST /compute/v2.1/servers => generated 408 bytes in 1929 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:23:43.188324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-770974fe-a79f-436e-8e1d-a0a62e768dfe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:43.189471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-770974fe-a79f-436e-8e1d-a0a62e768dfe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:43.219250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:43.220564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:43.239904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.240770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.241557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:43.255254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.256311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.257093 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:43.787237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-770974fe-a79f-436e-8e1d-a0a62e768dfe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:43.807992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-770974fe-a79f-436e-8e1d-a0a62e768dfe tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1245 microversion: 2.1 time: 0.627389 Aug 17 20:23:43.809870 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 118/230] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:43 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1245 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:43.819704 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:43.821408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:43.839282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.840465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.841551 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:43.843326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:43.844402 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:43.846157 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:43.978333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:44.000965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:44.004531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:44.005742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-71ab67cd-55fa-4750-86b6-803180a22db9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.802369 Aug 17 20:23:44.008129 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 113/231] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:43 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 806 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:44.026809 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:44.027728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:44.039312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:44.040376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:44.040831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:44.041780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:44.042258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:44.042719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:44.232599 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:44.268566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7747dc10-92db-45ef-88db-7dc882f40324 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1219 microversion: 2.1 time: 0.258713 Aug 17 20:23:44.278666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 114/232] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:44 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1219 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:44.361507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:44.383906 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-32eb5d5d-cc96-4c73-b132-0adec5ad63ab tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.566882 Aug 17 20:23:44.385360 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 119/233] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:43 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:44.405961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-e883fe09-65df-41d2-b45d-b7665eae5e34 req-4c71b8f8-27ff-4ad4-b84d-baa053a56609 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43150116-1ad7-4a0c-b292-98ee4307770d", "name": "network-vif-plugged", "status": "completed", "tag": "450fc8d5-29fd-4e49-8e9e-caca2f42f264"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:44.431909 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e883fe09-65df-41d2-b45d-b7665eae5e34 req-4c71b8f8-27ff-4ad4-b84d-baa053a56609 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:44.432873 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e883fe09-65df-41d2-b45d-b7665eae5e34 req-4c71b8f8-27ff-4ad4-b84d-baa053a56609 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:44.433634 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e883fe09-65df-41d2-b45d-b7665eae5e34 req-4c71b8f8-27ff-4ad4-b84d-baa053a56609 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:44.455339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-e883fe09-65df-41d2-b45d-b7665eae5e34 req-4c71b8f8-27ff-4ad4-b84d-baa053a56609 service nova] Creating event network-vif-plugged:450fc8d5-29fd-4e49-8e9e-caca2f42f264 for instance 43150116-1ad7-4a0c-b292-98ee4307770d on hv-cinder-83538 Aug 17 20:23:44.461872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-e883fe09-65df-41d2-b45d-b7665eae5e34 req-4c71b8f8-27ff-4ad4-b84d-baa053a56609 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060590 Aug 17 20:23:44.470228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 115/234] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:23:44.842397 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bbc032ae-7027-4f3d-9dc3-18b25f1e25c5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:44.843046 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bbc032ae-7027-4f3d-9dc3-18b25f1e25c5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:44.989153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bbc032ae-7027-4f3d-9dc3-18b25f1e25c5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:44.997274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bbc032ae-7027-4f3d-9dc3-18b25f1e25c5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1245 microversion: 2.1 time: 0.164372 Aug 17 20:23:44.997883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 120/235] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:44 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1245 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:45.104561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:45.105920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:45.161354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:45.162698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:45.163744 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:45.169076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:45.169874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:45.170920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:45.324267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:45.325954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:45.341346 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:45.345054 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:45.349593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:45.351628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:45.360188 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:45.361152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:45.643800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:45.657715 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-483277ae-ea60-487b-adc3-ec10fba4ed0f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1267 microversion: 2.1 time: 0.343523 Aug 17 20:23:45.658317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 121/236] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:45 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1267 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:45.663333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:45.679404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:45.683650 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:45.690090 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:45.692969 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:45.698815 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bf9bbaae-34ef-4766-802d-c64c3c994ca7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.629078 Aug 17 20:23:45.703145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 116/237] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:45 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:45.707407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:45.708980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:45.710234 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:45.712734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:45.714443 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:45.715735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:45.861007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1027630767", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-546023720", "security_groups": [{"name": "tempest-secgroup-smoke-55013731"}], "networks": [{"uuid": "ebc0beba-dbc0-40c8-a378-91c12cc85eb2"}], "block_device_mapping_v2": [{"uuid": "3f757b94-3114-4714-8152-0ff280b990ed", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:46.167420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:46.169507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] validate_networks() for [('ebc0beba-dbc0-40c8-a378-91c12cc85eb2', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:23:46.186419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-43775275-2e0b-4e36-99c0-8fa1bb4abe0c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.526970 Aug 17 20:23:46.187630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 122/238] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:45 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:46.192730 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:46.193452 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:46.201626 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.201946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.202394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.203174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.203631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.204051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.314499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:46.323686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-68837732-1fc7-42c7-901b-dfcd8a2b6a5a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1249 microversion: 2.1 time: 0.134929 Aug 17 20:23:46.324598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 123/239] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:46 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1249 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:46.684046 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:46.685212 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:46.697595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.698515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.699361 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.704463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.705138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.705667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.839095 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:46.847858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-31920424-8011-412a-bfe3-75590cda7fe4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1285 microversion: 2.1 time: 0.169661 Aug 17 20:23:46.848789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 124/240] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:46 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1285 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:46.857856 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:46.858540 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:46.862422 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:23:46.864712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:23:46.865459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.866041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.866533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.867312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.868182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.868703 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.869617 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:23:46.870426 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:23:46.871519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:23:46.937747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.938398 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.938886 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.942358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:46.942952 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:46.943408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:46.985170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Getting quotas for project 1291a3f047aa40278c9d3d048abc194e. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:46.990987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Getting quotas for user cfa791db71dd4345ba4b5988a33ec533 and project 1291a3f047aa40278c9d3d048abc194e. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:47.151072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:23:47.153712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3f757b94-3114-4714-8152-0ff280b990ed',volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:23:47.190616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:47.200594 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:47.212845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:47.219043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-733f85e4-8d90-45f9-955d-00dfbb015b47 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1406 microversion: 2.20 time: 0.368619 Aug 17 20:23:47.219775 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 125/241] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:46 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1406 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:47.229928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:47.235299 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:47.252755 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:47.253559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:47.254294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:47.266166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:47.266958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:47.271954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:47.526953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:47.552288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-013add9a-e65b-4e7c-8191-1fd2db17e600 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.330989 Aug 17 20:23:47.554269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 126/242] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:47 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:47.578770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:47.579621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:47.595974 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:47.596699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:47.597682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:47.599337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:47.599963 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:47.600706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:47.690700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:47.700173 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-de4abba7-abdc-4abf-b85e-73ef17f61064 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1297 microversion: 2.1 time: 0.143566 Aug 17 20:23:47.702716 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 127/243] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:47 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1297 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:47.859124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2d248780-ea2b-4e36-bd26-f72e8ddcbc9f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.003159 Aug 17 20:23:47.861634 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 117/244] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:23:45 2022] POST /compute/v2.1/servers => generated 404 bytes in 2007 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:23:47.879944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:47.879944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:47.898361 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:47.899084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:47.909079 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-68865bd6-e5b5-4e16-9eb0-8427cd36eae1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:47.909079 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-68865bd6-e5b5-4e16-9eb0-8427cd36eae1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:47.911082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:47.914285 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:47.915073 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:47.915635 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.146079 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:48.172919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-68865bd6-e5b5-4e16-9eb0-8427cd36eae1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:48.183039 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-68865bd6-e5b5-4e16-9eb0-8427cd36eae1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1088 microversion: 2.1 time: 0.300430 Aug 17 20:23:48.188176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 118/245] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:47 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1088 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:48.197542 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2fcdf5b0-16dc-44a0-86ef-3389b6a31f13 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1273 microversion: 2.1 time: 0.329749 Aug 17 20:23:48.219318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 128/246] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:47 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1273 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:48.270199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:48.271716 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:48.309323 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.311813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:48.314401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.315609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.322335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:48.322335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.582407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:48.590395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:48.605912 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.606431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:48.606902 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.607762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.608674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:48.609394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.615539 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:48.634303 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:48.640168 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:48.652668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3a8fdd89-d283-4496-a19d-f0caa9bb604d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1598 microversion: 2.20 time: 0.391450 Aug 17 20:23:48.655045 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 119/247] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:23:48 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1598 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:23:48.696600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:48.697175 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:48.719421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.719944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:48.726115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.728231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.729127 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:48.732553 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.957055 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-80812f79-260d-4197-9e79-f40741973794 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.271150 Aug 17 20:23:48.965831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 120/248] 10.222.0.64 () {60 vars in 1316 bytes} [Wed Aug 17 20:23:48 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-interface => generated 284 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:23:48.972013 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:48.973685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:48.997230 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.997230 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:48.997710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:48.998827 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:48.999526 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:49.000241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:49.295635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:49.310226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-107fa6ea-9f61-40ad-83ad-6c6f21262be8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1297 microversion: 2.1 time: 0.342696 Aug 17 20:23:49.318071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 121/249] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:48 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1297 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:49.322692 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2e95fcde-d88c-4635-966e-62677bdc4be3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:49.324370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2e95fcde-d88c-4635-966e-62677bdc4be3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:49.470570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:49.488550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e911b085-e0c8-451f-b769-8124e5f9fe6f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.912133 Aug 17 20:23:49.489661 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 129/250] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:48 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 914 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:49.507024 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:49.508031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:49.534871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:49.535673 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:49.536297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:49.537235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:49.537871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:49.539352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:49.894275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2e95fcde-d88c-4635-966e-62677bdc4be3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:49.902549 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2e95fcde-d88c-4635-966e-62677bdc4be3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1088 microversion: 2.1 time: 0.588078 Aug 17 20:23:49.918442 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 122/251] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:49 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1088 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:50.307140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:50.319607 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4fc940b2-8c12-4067-961d-c7b03d40a5df tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.828547 Aug 17 20:23:50.322044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 130/252] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:49 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 832 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:50.365209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:50.365860 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:50.374571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:50.375537 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:50.377495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:50.378566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:50.379396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:50.381221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:50.533169 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:50.533801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:50.545922 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:50.549538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:50.550541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:50.553524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:50.554020 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:50.555632 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:50.635623 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:50.675033 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c8465ba5-a0be-4069-9bac-dc4a0fec91f3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1303 microversion: 2.1 time: 0.317315 Aug 17 20:23:50.686083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 123/253] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:50 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1303 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:50.946944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:50.947876 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:50.967628 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:50.969508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:50.971691 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:50.974784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:50.980001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:50.980001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:51.031507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:51.530321 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:51.561816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-808cd073-4dcd-4991-9f77-0257b69d7740 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1130 microversion: 2.1 time: 0.621092 Aug 17 20:23:51.583135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 124/254] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:50 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1130 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:51.597363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:51.599088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:51.615077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:51.616487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:51.618136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:51.621341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:51.622491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:51.623578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:52.207426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:52.223016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1b59ca1d-ba78-4fcd-a695-fc02f864b579 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 1.697483 Aug 17 20:23:52.240835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 131/255] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:50 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 1714 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:52.245739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-32e4adef-c267-4a7e-8d33-367edebf7cec req-186d313d-da71-4877-8dcf-e75c051f7a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "875e6560-14af-4e70-8a8a-b6ddb6de1f7c", "tag": "0b783e0f-a846-4151-adac-9ee5a948ad60"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:52.258231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-32e4adef-c267-4a7e-8d33-367edebf7cec req-186d313d-da71-4877-8dcf-e75c051f7a98 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:52.259323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-32e4adef-c267-4a7e-8d33-367edebf7cec req-186d313d-da71-4877-8dcf-e75c051f7a98 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:52.260083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-32e4adef-c267-4a7e-8d33-367edebf7cec req-186d313d-da71-4877-8dcf-e75c051f7a98 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:52.281976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-32e4adef-c267-4a7e-8d33-367edebf7cec req-186d313d-da71-4877-8dcf-e75c051f7a98 service nova] Creating event network-changed:0b783e0f-a846-4151-adac-9ee5a948ad60 for instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c on hv-cinder-83538 Aug 17 20:23:52.289674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-32e4adef-c267-4a7e-8d33-367edebf7cec req-186d313d-da71-4877-8dcf-e75c051f7a98 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048875 Aug 17 20:23:52.291159 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 132/256] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:52.298931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:52.300279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:52.311521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:52.312537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:52.313221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:52.314205 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:52.315518 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:52.316248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:52.351231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:52.353881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:52.383490 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c41eb820-67c2-4e96-b7a3-9fb573af1e56 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.798273 Aug 17 20:23:52.399516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 125/257] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:51 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:52.637702 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:52.637702 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:52.664882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:52.665802 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:52.666701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:52.668035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:52.668882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:52.669668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:52.740437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:52.786782 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-48d1b7c4-544f-4b9a-92c4-df74cf3d7ee9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1303 microversion: 2.1 time: 0.493079 Aug 17 20:23:52.802337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 133/258] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:52 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1303 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:52.977869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:53.010811 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1b22ef43-6640-46d5-b633-a2861df67bcb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1194 microversion: 2.1 time: 0.404263 Aug 17 20:23:53.022110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 126/259] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:52 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1194 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:53.249260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:53.250186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:53.258823 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:53.259998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:53.260842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:53.262118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:53.262952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:53.263727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:53.419879 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:53.420708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:53.433582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:53.434376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:53.436511 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:53.436511 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:53.436511 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:53.437038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:53.714448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:53.723334 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-099948c4-57a2-4e95-b342-ba427c1d6252 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.478438 Aug 17 20:23:53.723940 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 134/260] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:53 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:53.740976 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:53.749882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b5976631-ddaa-49e7-97ac-12920587290f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.334699 Aug 17 20:23:53.750600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 127/261] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:53 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:53.809121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:53.809652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:53.816022 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:53.816515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:53.816948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:53.817658 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:53.818111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:53.818527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.051157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:54.051898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:54.058934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:54.059505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:54.060031 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.061479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:54.062006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:54.062659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.319492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:54.356566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ae7dcd32-80a8-49cd-8407-eca070fb2a1a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1204 microversion: 2.1 time: 0.307897 Aug 17 20:23:54.376201 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 128/262] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:54 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1204 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:54.392792 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a3f7b0ca-f267-499f-8376-6a26936198a9 req-8a0a42b1-18ec-450e-8811-ca9078727532 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43150116-1ad7-4a0c-b292-98ee4307770d", "tag": "450fc8d5-29fd-4e49-8e9e-caca2f42f264"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:54.432139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a3f7b0ca-f267-499f-8376-6a26936198a9 req-8a0a42b1-18ec-450e-8811-ca9078727532 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:54.436132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a3f7b0ca-f267-499f-8376-6a26936198a9 req-8a0a42b1-18ec-450e-8811-ca9078727532 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:54.437818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a3f7b0ca-f267-499f-8376-6a26936198a9 req-8a0a42b1-18ec-450e-8811-ca9078727532 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.474247 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a3f7b0ca-f267-499f-8376-6a26936198a9 req-8a0a42b1-18ec-450e-8811-ca9078727532 service nova] Creating event network-changed:450fc8d5-29fd-4e49-8e9e-caca2f42f264 for instance 43150116-1ad7-4a0c-b292-98ee4307770d on hv-cinder-83538 Aug 17 20:23:54.497723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:54.502452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a3f7b0ca-f267-499f-8376-6a26936198a9 req-8a0a42b1-18ec-450e-8811-ca9078727532 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111210 Aug 17 20:23:54.503653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 129/263] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:54.507883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-95aa64a5-2109-4655-b4d1-c7a608d01432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.702824 Aug 17 20:23:54.508460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 135/264] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:53 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 704 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:54.749518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:54.750342 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:54.766118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:54.766118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:54.766118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.766118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:54.766433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:54.766433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.772388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:54.773140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:54.792314 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:54.793098 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:54.793734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.805765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:54.805765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:54.805765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:54.997856 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=7 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:55.173780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:55.185213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:55.190203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5fb4f15d-96ac-4221-a643-eb2dd7e8be44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.445977 Aug 17 20:23:55.192109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 130/265] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:54 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:55.195928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9dd06717-2112-460d-9e70-a2353911214e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.427749 Aug 17 20:23:55.196984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 136/266] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:54 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:55.388233 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:55.390083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:55.414830 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:55.417274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:55.420751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:55.422252 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:55.424789 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:55.427051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:55.538864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:55.546432 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:55.561854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:55.562492 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:55.562979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:55.563961 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:55.565294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:55.565747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:56.072117 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:56.089878 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-919eac9e-4ac2-44e0-a423-11085b900cc8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1270 microversion: 2.1 time: 0.706990 Aug 17 20:23:56.095228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 131/267] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:55 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1270 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:56.105182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8cdc5f17-312b-40cd-9f8d-4b49ebdc188d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Action: 'create', calling method: .version_select at 0x7f23e29ded30>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1347997442", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDb2S+3Pg3lX427fLbPUdJ+KuRKHaa+cwViotMVwRo4jRPXYW2i8KW19wNBKqD8G/rMNSqcLo1dNuU9hjp9YUbnnhq+d3UVxdHe2fjSh/enxnenTJ391YtiMU2PmY8IJ3g=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:56.118179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:56.131207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-8cdc5f17-312b-40cd-9f8d-4b49ebdc188d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Getting quotas for project 6f2054a9c9ff437c8aceef06d0043526. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:56.140782 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-8cdc5f17-312b-40cd-9f8d-4b49ebdc188d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Getting quotas for user d8e620b4ca454bc5a6a19ae55138d861 and project 6f2054a9c9ff437c8aceef06d0043526. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:56.191280 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:56.203560 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8e922606-0315-4fb9-91f6-10ef2ab8bd1c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.675948 Aug 17 20:23:56.220165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 137/268] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:55 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:56.226260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:56.227216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:56.234966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:56.235750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:56.236344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:56.237438 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:56.238326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:56.239254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:56.379619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8cdc5f17-312b-40cd-9f8d-4b49ebdc188d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.282751 Aug 17 20:23:56.383746 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 132/269] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:23:56 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:56.394435 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:56.395751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:56.407026 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:56.407532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:56.407976 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:56.408798 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:56.409270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:56.409703 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:56.933215 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:56.942880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ee0ae5c0-7ca1-4d7e-be88-273d50052aed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1723 microversion: 2.1 time: 0.721216 Aug 17 20:23:56.943638 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 138/270] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:56 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1723 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:56.949616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1279822121", "imageRef": "d07dce87-c3b4-4663-acc3-6c9a50a1a6df", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1347997442", "networks": [{"uuid": "fa16c0c3-7cc7-484f-8318-4f3ce8c243ba"}]}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:56.964822 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:23:57.014665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] validate_networks() for [('fa16c0c3-7cc7-484f-8318-4f3ce8c243ba', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:23:57.040967 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:57.049536 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1b2c32dd-08bc-4910-bf07-d4670fab4862 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.664281 Aug 17 20:23:57.050376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 133/271] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:56 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:57.119332 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:57.121466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:57.134405 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:57.135201 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:57.135659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:57.136731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:57.137211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:57.137639 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:57.783706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:57.792737 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6cced619-150c-4520-9142-5940f0a01084 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.680335 Aug 17 20:23:57.793331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 134/272] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:57 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:23:57.797941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:57.798561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:57.805961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:57.806453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:57.807102 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:57.807812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:57.808478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:57.808915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:58.177557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:58.186906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cfcb0cb9-717b-4420-aa0d-2db83db8bda0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.392418 Aug 17 20:23:58.195873 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 135/273] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:57 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:58.195873 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1430413456", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "networks": [{"uuid": "37d2423c-b603-45a9-b465-f76696c65e59"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:58.273898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] validate_networks() for [('37d2423c-b603-45a9-b465-f76696c65e59', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:23:58.452912 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:23:58.454100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:23:58.459025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:23:58.463977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:23:58.466662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:23:58.495735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:58.497076 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:58.498107 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:58.500228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:58.501614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:58.504391 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:58.554162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Getting quotas for project 6f2054a9c9ff437c8aceef06d0043526. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:58.565556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Getting quotas for user d8e620b4ca454bc5a6a19ae55138d861 and project 6f2054a9c9ff437c8aceef06d0043526. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:58.600237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:23:58.604894 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='d07dce87-c3b4-4663-acc3-6c9a50a1a6df',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:23:58.860036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f7d0c01b-2bc1-4257-98d7-0d2c126b08ec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.914732 Aug 17 20:23:58.865853 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 139/274] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:23:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:23:58.873351 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:58.873978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:58.880935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:58.881442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:58.881888 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:58.882753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:58.883248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:58.884163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.384335 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:59.394342 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2ab4bc1f-974d-4edc-9bd9-251e0746fd65 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1700 microversion: 2.1 time: 0.524981 Aug 17 20:23:59.409403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 140/275] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:58 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1700 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:59.415622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:59.416468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:59.424619 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.425341 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.426104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.427078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.427762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.428355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.660208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:23:59.660802 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:23:59.661299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:23:59.661785 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:23:59.662274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:23:59.703293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.707145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.707145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.707145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.707145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.707753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.735821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Getting quotas for project 11fb3890c76b4b60bac49fdcb8dbb71e. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:23:59.741096 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Getting quotas for user 4e62a4adc12f4963b09b495122c0a6d5 and project 11fb3890c76b4b60bac49fdcb8dbb71e. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:23:59.756597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:23:59.759782 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:23:59.801084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:23:59.811437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-273042c4-f5b9-4939-ab73-db3abdab1050 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.400230 Aug 17 20:23:59.812047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 141/276] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:59 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:23:59.817147 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-b4b07434-43f3-4af7-83e7-316a01452fdb req-bfce7e7a-9201-48ae-8cba-6b39f6474c36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb5faa-99aa-4e6a-9d28-c82d7c47222d", "tag": "161d7ebe-907f-42da-9379-adf417700bb6"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:59.830348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-b4b07434-43f3-4af7-83e7-316a01452fdb req-bfce7e7a-9201-48ae-8cba-6b39f6474c36 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.831275 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-b4b07434-43f3-4af7-83e7-316a01452fdb req-bfce7e7a-9201-48ae-8cba-6b39f6474c36 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.831954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-b4b07434-43f3-4af7-83e7-316a01452fdb req-bfce7e7a-9201-48ae-8cba-6b39f6474c36 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.850388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-b4b07434-43f3-4af7-83e7-316a01452fdb req-bfce7e7a-9201-48ae-8cba-6b39f6474c36 service nova] Creating event network-changed:161d7ebe-907f-42da-9379-adf417700bb6 for instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d on hv-cinder-83538 Aug 17 20:23:59.856533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-b4b07434-43f3-4af7-83e7-316a01452fdb req-bfce7e7a-9201-48ae-8cba-6b39f6474c36 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042795 Aug 17 20:23:59.857542 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 142/277] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:59.863106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-723b5b8d-d2c6-4f6a-b2ac-aacb8af98bca req-f05a3fd4-c546-4232-a52e-fa2bfecc7b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875e6560-14af-4e70-8a8a-b6ddb6de1f7c", "name": "network-vif-plugged", "status": "completed", "tag": "0b783e0f-a846-4151-adac-9ee5a948ad60"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:23:59.874865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-723b5b8d-d2c6-4f6a-b2ac-aacb8af98bca req-f05a3fd4-c546-4232-a52e-fa2bfecc7b0d service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.875356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-723b5b8d-d2c6-4f6a-b2ac-aacb8af98bca req-f05a3fd4-c546-4232-a52e-fa2bfecc7b0d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.875822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-723b5b8d-d2c6-4f6a-b2ac-aacb8af98bca req-f05a3fd4-c546-4232-a52e-fa2bfecc7b0d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.890809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-723b5b8d-d2c6-4f6a-b2ac-aacb8af98bca req-f05a3fd4-c546-4232-a52e-fa2bfecc7b0d service nova] Creating event network-vif-plugged:0b783e0f-a846-4151-adac-9ee5a948ad60 for instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c on hv-cinder-83538 Aug 17 20:23:59.896228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-723b5b8d-d2c6-4f6a-b2ac-aacb8af98bca req-f05a3fd4-c546-4232-a52e-fa2bfecc7b0d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037248 Aug 17 20:23:59.896839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 143/278] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:23:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:23:59.904007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:59.904753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:23:59.911884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.912384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.912830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.913665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:23:59.914715 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:23:59.915154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:23:59.949685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-122bc880-5efa-4b0a-8521-c4a4e94a55af tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.760914 Aug 17 20:23:59.950996 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 136/279] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:23:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 1762 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:23:59.959667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-16edec8c-2959-4325-a3fe-14967a8125c9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:23:59.960597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-16edec8c-2959-4325-a3fe-14967a8125c9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:00.095506 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-16edec8c-2959-4325-a3fe-14967a8125c9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:00.119129 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-16edec8c-2959-4325-a3fe-14967a8125c9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1259 microversion: 2.1 time: 0.163528 Aug 17 20:24:00.120532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 137/280] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:59 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:00.139684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:00.142375 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:00.159855 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:00.163558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:00.166864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:00.168859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:00.169686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:00.170429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:00.223642 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:00.241227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3dca76bb-e7c0-4e2e-85e8-195d7a9ff2f9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.342819 Aug 17 20:24:00.259769 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 144/281] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:23:59 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:00.269502 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-de181946-0afb-4326-8e13-ac23afa10239 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:00.277269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de181946-0afb-4326-8e13-ac23afa10239 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:00.278450 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de181946-0afb-4326-8e13-ac23afa10239 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:00.279442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de181946-0afb-4326-8e13-ac23afa10239 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:00.380704 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-de181946-0afb-4326-8e13-ac23afa10239 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Going to try to start instance {{(pid=121275) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 20:24:00.396476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:00.406027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0faf3a23-c79a-441e-a55c-0107a748442a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.283416 Aug 17 20:24:00.406817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 138/282] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:00 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:00.423188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ef0476ee-2a00-46f3-9776-c1dddc90eaa0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:00.426262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ef0476ee-2a00-46f3-9776-c1dddc90eaa0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:00.485966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef0476ee-2a00-46f3-9776-c1dddc90eaa0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:00.494037 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ef0476ee-2a00-46f3-9776-c1dddc90eaa0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1219 microversion: 2.1 time: 0.074831 Aug 17 20:24:00.494799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 139/283] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:00 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:00.712051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-de181946-0afb-4326-8e13-ac23afa10239 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action" status: 202 len: 0 microversion: 2.1 time: 0.450153 Aug 17 20:24:00.712718 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 145/284] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:24:00 2022] POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action => generated 0 bytes in 453 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:24:00.722565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:00.723220 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:00.729846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:00.730353 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:00.730848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:00.731554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:00.732013 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:00.732440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:00.835516 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:00.836998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:00.843663 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:00.844122 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:00.844567 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:00.845293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:00.845757 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:00.846264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:00.887500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:00.897088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6e1cd0e6-f4bf-467d-a2da-b878412686ac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.178605 Aug 17 20:24:00.897685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 140/285] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:00 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:01.125178 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:01.140548 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-71af18df-0530-4007-91b1-62f46145d262 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.307876 Aug 17 20:24:01.140548 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 146/286] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:00 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:01.165824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:01.166724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:01.175257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.175999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.176624 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.177912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.178523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.179121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.277255 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:01.277880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:01.280362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:01.292003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.292905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.294099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.295228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.295861 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.296641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.706218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:01.716833 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-af004c57-fd86-4a3c-b5e3-077ff0a63a5e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1263 microversion: 2.1 time: 0.564693 Aug 17 20:24:01.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 141/287] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:01 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1263 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:01.723523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:01.724292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:01.735960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.736458 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.736914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.737632 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.738085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.738510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.866690 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:01.876785 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5c8eb371-12cf-4bd3-8d2d-5b5bc4852fa1 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.605861 Aug 17 20:24:01.892259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 147/288] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:01 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:01.892259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:01.892259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:01.894876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.895674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.896192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.896995 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.897595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.899085 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:01.948527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:01.964017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b603e485-6ce8-4f19-b41d-35e2169f633d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.244250 Aug 17 20:24:01.972491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 142/289] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:01 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:01.975008 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-bee24049-8b79-4b31-8237-d38bc9ea2cef req-727a109e-c79d-4fa3-aa3a-6b17b23fe8a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a86ddd-90d5-466f-8a34-6cc8d6d30690", "tag": "552f575e-1f5c-477e-8e14-8836c2be669b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:01.993209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-bee24049-8b79-4b31-8237-d38bc9ea2cef req-727a109e-c79d-4fa3-aa3a-6b17b23fe8a1 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:01.993792 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-bee24049-8b79-4b31-8237-d38bc9ea2cef req-727a109e-c79d-4fa3-aa3a-6b17b23fe8a1 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:01.994499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-bee24049-8b79-4b31-8237-d38bc9ea2cef req-727a109e-c79d-4fa3-aa3a-6b17b23fe8a1 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.012483 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-bee24049-8b79-4b31-8237-d38bc9ea2cef req-727a109e-c79d-4fa3-aa3a-6b17b23fe8a1 service nova] Creating event network-changed:552f575e-1f5c-477e-8e14-8836c2be669b for instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 on hv-cinder-83538 Aug 17 20:24:02.019294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:02.020985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-bee24049-8b79-4b31-8237-d38bc9ea2cef req-727a109e-c79d-4fa3-aa3a-6b17b23fe8a1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053344 Aug 17 20:24:02.022218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 143/290] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:02.033423 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:02.035009 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:02.040756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e0a3fa72-fe2f-4783-ad2b-3bc3e8498273 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1223 microversion: 2.1 time: 0.160748 Aug 17 20:24:02.042123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 148/291] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:01 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1223 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:02.048012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.049622 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.050686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.052507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.053732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.055470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.183283 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:02.184132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:02.193009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.197784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.197784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.197784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.197784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.198176 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.303896 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:02.314272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f48c89b8-1404-48c9-af57-49c889da78fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.289444 Aug 17 20:24:02.314903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 144/292] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:02 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:02.406657 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:02.416284 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5e355360-9273-473a-ab0d-e6e2868069a5 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1315 microversion: 2.1 time: 0.238438 Aug 17 20:24:02.416875 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 149/293] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:02 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:02.737821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:02.738491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:02.745208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.745731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.746155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.746889 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.747395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.747844 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.827947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:02.837319 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6ccc12e5-fc06-4e2a-8371-f78335e7a30e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1311 microversion: 2.1 time: 0.103285 Aug 17 20:24:02.837997 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 145/294] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:02 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:02.903453 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:02.904830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:02.921306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.923499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.924130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.925005 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:02.926859 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:02.927608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:02.998593 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:02.999492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:03.006264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.007040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.007665 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.009080 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.009686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.010264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.035607 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:03.147561 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:03.163446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-66237d19-53a5-4109-8d12-c6653fdd1ee2 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.264399 Aug 17 20:24:03.167042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 150/295] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:02 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:03.174329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:03.175454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:03.183186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.187933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.187933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.187933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.187933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.188461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.191256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:03.220385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:03.242268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fe94109e-17ee-4944-a78e-c3443e196040 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.248074 Aug 17 20:24:03.244154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 146/296] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:02 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:03.267620 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:03.278325 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-69475bef-c656-400c-ae2d-c93012994fdc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1215 microversion: 2.1 time: 0.109102 Aug 17 20:24:03.279797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 151/297] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:03 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1215 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:03.351091 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:03.352193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:03.361872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.362372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.362847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.363571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.364040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.364463 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.438616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:03.439274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:03.462078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.469009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.470434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.472185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.473367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.475047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.719617 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:03.730658 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5a135abb-2f73-41d4-8b38-26bbe6bb6b50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.384684 Aug 17 20:24:03.745762 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 147/298] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:03 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:03.771664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:03.779448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a0d29d54-810a-4672-ac34-53bd2eeadd8b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1465 microversion: 2.1 time: 0.345115 Aug 17 20:24:03.780067 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 152/299] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:03 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1465 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:03.827582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:03.828106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:03.834767 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.835264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.835765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.836542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.837109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.837540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.863084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:03.864245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:03.874760 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.875657 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.876382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.877760 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:24:03.877932 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:03.878595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:03.879391 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:03.980446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:03.994437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-16d677dd-174d-4798-8bca-c3f37434513a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1319 microversion: 2.1 time: 0.137545 Aug 17 20:24:03.995492 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 153/300] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:03 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1319 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:04.189389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:04.190208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:04.205737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.206751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.207198 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.212138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.212632 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.213253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.259001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-814d95d1-05ac-47e8-85c3-a7ef107d397c tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "DELETE /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 204 len: 0 microversion: 2.1 time: 0.435288 Aug 17 20:24:04.260657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 148/301] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:24:03 2022] DELETE /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 0 bytes in 438 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:24:04.275874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:04.277295 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:04.293524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.296955 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.298985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.300264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.301943 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.304077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.540557 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:04.547967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-81179ed9-ae4f-440b-8eb8-937f423efe02 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.362755 Aug 17 20:24:04.549031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 154/302] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:04 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:04.555214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:04.556203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:04.562789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.563324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.563761 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.564495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.565003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.565431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.586984 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:04.594854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4e7b30fb-99da-4871-a095-6e4db14abd92 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.329712 Aug 17 20:24:04.595446 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 149/303] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:04 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:04.600779 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:04.604068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:04.610836 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.611452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.611944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.612899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.613365 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.613839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.697003 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:04.709613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9301b21a-5969-42df-b3c1-926b6210447d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1271 microversion: 2.1 time: 0.112489 Aug 17 20:24:04.711397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 150/304] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:04 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1271 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:04.717732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-b2e292ae-c8ca-4f15-98ae-a6ad1b26994b req-d94ca5d3-f73c-445c-a2c9-5182af7b02b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fb5faa-99aa-4e6a-9d28-c82d7c47222d", "name": "network-vif-plugged", "status": "completed", "tag": "161d7ebe-907f-42da-9379-adf417700bb6"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:04.728474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b2e292ae-c8ca-4f15-98ae-a6ad1b26994b req-d94ca5d3-f73c-445c-a2c9-5182af7b02b4 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.728962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b2e292ae-c8ca-4f15-98ae-a6ad1b26994b req-d94ca5d3-f73c-445c-a2c9-5182af7b02b4 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.729397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b2e292ae-c8ca-4f15-98ae-a6ad1b26994b req-d94ca5d3-f73c-445c-a2c9-5182af7b02b4 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.741521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-b2e292ae-c8ca-4f15-98ae-a6ad1b26994b req-d94ca5d3-f73c-445c-a2c9-5182af7b02b4 service nova] Creating event network-vif-plugged:161d7ebe-907f-42da-9379-adf417700bb6 for instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d on hv-cinder-83538 Aug 17 20:24:04.746927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-b2e292ae-c8ca-4f15-98ae-a6ad1b26994b req-d94ca5d3-f73c-445c-a2c9-5182af7b02b4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033617 Aug 17 20:24:04.748004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 151/305] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:04.758864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:04.758864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:04.763519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:04.764567 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.765059 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.765498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.766211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:04.766699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:04.767126 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:04.771590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3cbf9946-8a9c-4148-b289-be04f83ebc76 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.221045 Aug 17 20:24:04.772172 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 155/306] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:04 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:04.920482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:04.931111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7bce5fc6-73d2-4209-9327-425152f12030 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.179026 Aug 17 20:24:04.931712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 152/307] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:04 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:05.017563 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:05.018196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:05.025719 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.026199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.026660 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.027355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.027931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.028374 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.095441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:05.104375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bc8618ca-bcc0-4641-869f-140500504bac tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1329 microversion: 2.1 time: 0.091207 Aug 17 20:24:05.104984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 156/308] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:05 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1329 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:05.570213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:05.570769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:05.577030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.577518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.577954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.578673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.579136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.579582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.624522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:05.625595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:05.632471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.632873 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.633381 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.634237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.634737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.635170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.787178 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:05.795542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-15f642ae-e4b2-4847-b37d-9cdc4370cff3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.229370 Aug 17 20:24:05.796124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 153/309] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:05 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:05.800618 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:05.801363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:05.807150 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.807642 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.808163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.809570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.810123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.810674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.811332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:05.819625 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-630235be-cbda-4716-b7ca-e24b0d28eab9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.200856 Aug 17 20:24:05.820474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 157/310] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:05 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:05.825362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:05.825968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:05.832020 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.832519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.832957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.833690 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.834151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.834578 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.884249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:05.892111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b889f539-d88e-4c4a-889a-6fd275547e96 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1271 microversion: 2.1 time: 0.094908 Aug 17 20:24:05.892693 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 154/311] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:05 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:05.959218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:05.960197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:05.967812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.968316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.968774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.969513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:05.969982 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:05.970417 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:05.997505 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:06.005747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9d3259fe-6bd4-48a3-89ae-e8bd1d56c13d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.183952 Aug 17 20:24:06.006679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 158/312] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:05 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:06.125801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:06.126578 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:06.133485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:06.134387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:06.134614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:06.135352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:06.135814 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:06.136243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:06.137598 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:06.145856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a95751ad-eea0-4520-8418-71b21b66bcdb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.190836 Aug 17 20:24:06.146428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 155/313] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:05 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:06.201089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:06.208862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-423f084e-e7b7-490a-8d2d-e46ac22847c8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1329 microversion: 2.1 time: 0.087030 Aug 17 20:24:06.209448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 159/314] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:06 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1329 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:06.816403 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:06.816941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:06.823723 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:06.824184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:06.824620 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:06.825360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:06.825816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:06.826242 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:06.842068 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:06.842876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:06.849443 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:06.859411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:06.859411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:06.859411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:06.859411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:06.859802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.046204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:07.065661 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b3caa0c5-ffc3-477a-be52-043779043b7d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.253471 Aug 17 20:24:07.066726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 156/315] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:06 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:07.068307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:07.078770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8b453675-18fe-4846-a628-06a9c90e8cbe tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.240596 Aug 17 20:24:07.079727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 160/316] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:06 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:07.092264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:07.093383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:07.095905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:07.096938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:07.104357 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.105190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.105915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.107148 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.107921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.108296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.108619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.109989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.111405 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.112605 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.113388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.114106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.232213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:07.246918 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-92861a93-484d-491f-ace4-2d011b2835c3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1271 microversion: 2.1 time: 0.161078 Aug 17 20:24:07.248237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 157/317] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:07 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1271 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:07.255754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:07.260390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:07.264221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.264803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.265299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.266200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.266443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.266896 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.365113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:07.373363 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4411e9eb-eb26-4787-a88a-6e8484b8c23d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.286417 Aug 17 20:24:07.373959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 161/318] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:07 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:07.378829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:07.379453 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:07.400543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.400543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.400543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.400543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:07.401025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:07.401025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:07.457005 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:07.466131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-05f3c45d-a196-464d-83d1-d8e27a1bd032 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.214523 Aug 17 20:24:07.466727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 158/319] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:07 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:07.474934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:07.490359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-26947294-db87-4b2c-b1a4-28d61ece2b92 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1317 microversion: 2.1 time: 0.115315 Aug 17 20:24:07.490993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 162/320] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:07 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1317 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:08.095895 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:08.096670 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:08.100603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:08.101455 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:08.109901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.110388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.110855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.111946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.112041 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.112136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.112856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.112964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.113634 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.114727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.115973 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.116627 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.325761 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:08.333866 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-32e77287-2c95-4ec3-a62c-29a46e9e55e0 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.237463 Aug 17 20:24:08.334451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 163/321] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:08 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:08.339356 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:08.339595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:08.340217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:08.346397 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.346913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.347346 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.348041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.348491 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.348912 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.350884 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9f15afa2-21c4-4fb8-8dff-5fb38fce9bb0 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.258919 Aug 17 20:24:08.351697 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 159/322] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:08 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:08.411706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:08.412874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:08.417530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:08.421826 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.422586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.423209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.423935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.424560 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.424991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.426590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f1af20c0-02cb-43c1-9d32-026f1292672d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1279 microversion: 2.1 time: 0.091075 Aug 17 20:24:08.427425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 164/323] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:08 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1279 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:08.493282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:08.494292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:08.501037 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.501664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.502373 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.503156 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.503629 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.504258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.529038 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:08.582845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=6 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:08.850586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:08.856719 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:08.862669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-070f0872-1dc5-4c11-9405-d3bbc61f82f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.458021 Aug 17 20:24:08.867999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 160/324] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:08 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:08.874040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:08.874684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:08.892128 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.892419 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.892728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.894855 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:08.894855 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:08.894855 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:08.899796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8fb6bd4a-049d-4b11-b937-ff078a0b1fe3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.409232 Aug 17 20:24:08.911645 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 165/325] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:08 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:08.981834 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:08.984335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:08.993309 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d6a4a952-6bea-45e2-9a27-52d42860a0c7 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1317 microversion: 2.1 time: 0.123943 Aug 17 20:24:09.009261 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 161/326] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:08 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1317 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:09.360574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:09.361205 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:09.371650 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.372621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.373417 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.374410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.375257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.375867 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.379376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:09.381348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:09.392220 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.392722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.393190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.394118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.395301 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.406178 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.666980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:09.676153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-09d81e26-711d-4c5e-8ede-cd1a77ef8807 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.322456 Aug 17 20:24:09.680880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 166/327] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:09 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:09.688104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:09.689154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:09.700012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.700757 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.701378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.702942 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.703589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.704170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.723158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:09.736287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:09.749525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a5decdb5-03db-46f5-80cd-a9412c6b0848 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.374768 Aug 17 20:24:09.763958 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 162/328] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:09 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:09.801780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:09.806383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:09.812639 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3bc78af7-2d31-461f-a1a0-509bc85f60b2 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1277 microversion: 2.1 time: 0.128170 Aug 17 20:24:09.812639 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 167/329] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:09 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1277 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:09.894099 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:09.895596 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:09.904825 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.905683 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.906613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.908116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.909251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.910817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.936271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:09.938251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:09.948487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.949344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.950150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:09.951506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:09.952190 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:09.952771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.133139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:10.158270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3f76dd8e-afce-4cf9-989e-7df3136f02d7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.268343 Aug 17 20:24:10.159343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 163/330] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:09 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:10.181636 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:10.183070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:10.199220 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.199952 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.200590 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.201829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.202460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.203192 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.208465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:10.223274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2d343683-86b3-4183-bd99-8252aaf6ea1e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.292092 Aug 17 20:24:10.224141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 168/331] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:09 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:10.352961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:10.360633 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dba2120e-2b8c-461a-91c5-1922f9b09c98 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.199906 Aug 17 20:24:10.361215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 164/332] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:10 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:10.703245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:10.703977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:10.711472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.712003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.712477 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.713276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.713767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.714199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.772565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:10.773206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:10.775649 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=36 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:10.776329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:10.781639 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.782121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.782751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.783583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.783921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.784331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.899046 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:10.907328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-80440738-30db-4082-9eb6-8a376ee3de0b tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.207989 Aug 17 20:24:10.908028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 169/333] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:10 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:10.913258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:10.914487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:10.921049 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.921688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.922250 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.924833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:10.924833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:10.924833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:10.954436 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:10.965149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-01b5de72-69c4-4830-8c81-af95c4d77f7c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.197045 Aug 17 20:24:10.965835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 165/334] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:10 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:11.082227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:11.090597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5c809967-5c01-44ca-820b-e71f8bb60dc4 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.181435 Aug 17 20:24:11.095572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 170/335] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:10 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:11.196479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:11.196993 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:11.204073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.204561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.205038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.205748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.206248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.206712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.246445 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:11.247106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:11.253857 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.254363 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.254848 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.255567 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.256029 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.256462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.679875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:11.688107 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:11.690070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f3c9b7c7-86d0-4343-91a5-4dd3bf23cc7c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.497593 Aug 17 20:24:11.690956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 166/336] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:11 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:11.696253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:11.697452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:11.705546 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.706159 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.706608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.707378 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.707873 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.708300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.709529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9aa3a39d-b28b-4e99-9534-8c44fc1e140e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.467757 Aug 17 20:24:11.710462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 171/337] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:11 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:11.934697 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:11.935384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:11.941899 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.942489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.943091 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.944096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:11.944567 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:11.945322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:11.959150 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:11.967654 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b2cede8d-7030-49d2-a30d-a0982570b114 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.275927 Aug 17 20:24:11.968232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 167/338] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:11 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:11.995589 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:11.996826 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:12.005534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.006112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.006710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.007644 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.008207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.008674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.178727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:12.192355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9e3edeaf-33f5-43fd-a38c-18879f73fb36 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.260512 Aug 17 20:24:12.193137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 172/339] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:11 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:12.208453 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:12.210354 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:12.225021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.226040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.227775 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.229421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:12.229646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.230224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.231159 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.240793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-837e4d03-4c29-45d4-b38b-8f393e7bc82e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.256021 Aug 17 20:24:12.241700 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 168/340] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:11 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:12.269985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-913bf981-07cc-41d1-8a57-c14bb4e0d8ed req-e303a87b-d496-4e5d-97a8-2843f58caf51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875e6560-14af-4e70-8a8a-b6ddb6de1f7c", "name": "network-vif-unplugged", "status": "completed", "tag": "0b783e0f-a846-4151-adac-9ee5a948ad60"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:12.281675 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-913bf981-07cc-41d1-8a57-c14bb4e0d8ed req-e303a87b-d496-4e5d-97a8-2843f58caf51 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.282172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-913bf981-07cc-41d1-8a57-c14bb4e0d8ed req-e303a87b-d496-4e5d-97a8-2843f58caf51 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.282645 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-913bf981-07cc-41d1-8a57-c14bb4e0d8ed req-e303a87b-d496-4e5d-97a8-2843f58caf51 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.294899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-913bf981-07cc-41d1-8a57-c14bb4e0d8ed req-e303a87b-d496-4e5d-97a8-2843f58caf51 service nova] Creating event network-vif-unplugged:0b783e0f-a846-4151-adac-9ee5a948ad60 for instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c on hv-cinder-83538 Aug 17 20:24:12.300292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-913bf981-07cc-41d1-8a57-c14bb4e0d8ed req-e303a87b-d496-4e5d-97a8-2843f58caf51 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034265 Aug 17 20:24:12.300893 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 169/341] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:24:12.392965 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:12.402871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-eeef61af-0fc0-48cf-8b5f-83413880e350 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.207920 Aug 17 20:24:12.403491 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 173/342] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:12 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:12.712560 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:12.713280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:12.720422 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.723917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.723917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.723917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.723917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.724291 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.732031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:12.732680 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:12.739671 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.740178 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.740712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.741472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.742465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.743036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.937883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:12.945328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:12.945908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7ab16a76-9355-41f6-9ca8-9e12f7328b18 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.238096 Aug 17 20:24:12.946503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 170/343] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:12 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:12.954148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0207d5b8-6914-4607-987f-5e28037e879e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.226400 Aug 17 20:24:12.954734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 174/344] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:12 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:12.989139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:12.989753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:12.997433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.997930 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:12.998372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:12.999121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:12.999580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.000010 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.139418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:13.147783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2e6b2549-07db-4520-92cc-a4855189032b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.162504 Aug 17 20:24:13.148582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 171/345] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:12 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:13.230292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:13.231034 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:13.237571 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.238127 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.238573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.239319 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.239776 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.240199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.264808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:13.265666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:13.272329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.273501 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.274043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.274872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.275332 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.275759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.459877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:13.467535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-09eb1304-d95d-4b79-8a6c-60d89fe8be66 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.242469 Aug 17 20:24:13.468130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 175/346] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:13 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:13.472480 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:13.472702 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:13.473497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:13.480253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.481023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fec91198-f40a-4790-a0ed-c316a2aefabe tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.221270 Aug 17 20:24:13.481399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.481540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 172/347] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:13 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:13.481964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.482743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.483230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.483660 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.645006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:13.655616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0d02d98f-042d-4cdc-9713-4a6b1c225de3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.186287 Aug 17 20:24:13.656474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 176/348] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:13 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:13.970871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:13.971496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:13.976657 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:13.977996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:13.978927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.979475 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.979916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.980641 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.981089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.981508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.984487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.985236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.985754 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:13.986463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:13.986947 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:13.987366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.197284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:14.204966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:14.206014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-33e6766b-819e-4066-a568-b2a89dead938 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.239808 Aug 17 20:24:14.206884 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 173/349] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:13 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:14.213339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:14.214176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:14.214332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1b56f803-0bd1-424f-a509-7dcba94f9d5a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.242393 Aug 17 20:24:14.215300 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 177/350] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:13 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:14.224652 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.225215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.225953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.230671 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.230671 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.230671 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.425312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:14.433245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a3db7937-d4e6-4653-a906-3ef6eb456430 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.224657 Aug 17 20:24:14.433819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 174/351] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:14 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:14.489420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:14.489938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:14.496615 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.497106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.497541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.498252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.498857 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.499287 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.502318 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:14.502968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:14.509857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.510359 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.510869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.511592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.512066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.512478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.721347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:14.731170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ebb5874b-c027-4a62-b1d1-7e9a0a8137af tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.245932 Aug 17 20:24:14.731770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 178/352] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:14 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:14.750306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:14.750306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:14.750306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.750306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.751684 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.751684 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:14.751684 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:14.751684 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:14.760311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:14.769825 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-232fe5d7-b9ae-411b-a596-b0f6a9e6dca7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.272084 Aug 17 20:24:14.770402 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 175/353] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:14 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:14.897149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:14.905404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d03b5a38-f43e-49b4-95cd-1425d3dc6e4e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.172410 Aug 17 20:24:14.905883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 179/354] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:14 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:15.233132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:15.233949 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:15.239619 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:15.241116 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:15.241405 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.242840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.243346 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.244101 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.244574 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.245090 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.253771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.254433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.255128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.257193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.257193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.257193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.502450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:15.510805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5542a3ce-3d23-4648-bcb5-b5fd9044a872 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.281708 Aug 17 20:24:15.511718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 176/355] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:15 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:15.516457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:15.517077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:15.523641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:15.525916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.526499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.526966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.527678 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.528158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.528640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.532086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2a643adc-185d-4319-883d-c6eccb7f403c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.298329 Aug 17 20:24:15.532664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 180/356] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:15 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:15.670513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:15.679115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cee28b0a-50d2-42d9-8634-b3c9206b7f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.166231 Aug 17 20:24:15.680127 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 177/357] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:15 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:15.757078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:15.757747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:15.763754 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.764221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.764647 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.765322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.765771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.766187 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.791921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:15.792643 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:15.798772 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.799258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.799697 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.800395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.800883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.801310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.965916 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:15.975342 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cb4ad59c-2ba9-48b2-a9af-e3cbbda07fc2 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.224045 Aug 17 20:24:15.975931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 181/358] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:15 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:15.982120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:15.982798 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:15.989109 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.989597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.990035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:15.990800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:15.995337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:15.995337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:16.000135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:16.008755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ce60bf21-ae60-4465-a79f-918214e2ae2e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.221213 Aug 17 20:24:16.009245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 178/359] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:15 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:16.128644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:16.137089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-36ef4ec9-432b-4057-a320-3c84b80f3b4a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.159546 Aug 17 20:24:16.137660 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 182/360] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:15 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:16.532579 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:16.533248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:16.539731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:16.540221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:16.540659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:16.541362 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:16.541818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:16.542244 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:16.545060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:16.554967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:16.555858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:16.562481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:16.563003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:16.564574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:16.564574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:16.564574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:16.564950 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:16.748913 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:16.757131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dbe95fe4-a02f-4a68-957b-4efe152ba6c4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.228307 Aug 17 20:24:16.758388 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 179/361] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:16 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:16.763185 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:16.763791 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:16.764250 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:16.769839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:16.770453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:16.770863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:16.771458 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:16.772085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:16.772503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:16.774373 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-57932f0b-afe9-419d-b4e1-741be6133b44 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.223955 Aug 17 20:24:16.774978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 183/362] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:16 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:16.915808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:16.923705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3fd6822c-8f5f-48c7-80bf-9fb1a77ee88b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.164197 Aug 17 20:24:16.924542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 180/363] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:16 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:16.998194 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:16.998827 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:17.008077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.008077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.008077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.008077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.008534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.008534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.024841 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:17.031052 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:17.031747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:17.040203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.040699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.041204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.041946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.042434 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.042898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.216205 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:17.223921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1fd784b2-6ba2-4b70-8b0c-4eca43e27c8f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.229901 Aug 17 20:24:17.224486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 184/364] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:16 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:17.230199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:17.233133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:17.233842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:17.238432 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-42352c05-6672-4723-8dbc-d3c50126ffab tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.211898 Aug 17 20:24:17.239164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 181/365] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:17 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:17.240412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.241016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.242227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.243156 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.243617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.244041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.384007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:17.391707 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-fb7c03a9-edb5-4192-848d-0ae459eda56e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.162963 Aug 17 20:24:17.392280 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 185/366] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:17 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:17.779672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:17.780283 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:17.786780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.787280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.787724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.789141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.789636 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.790223 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.800483 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:17.801093 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:17.807723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.808260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.808659 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:17.809368 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:17.809818 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:17.810238 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.007348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:18.015797 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e360f536-bda5-403f-846e-31f3f204a37f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.240050 Aug 17 20:24:18.016390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 182/367] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:17 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:18.020081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:18.021076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:18.021702 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:18.029072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.029571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.030018 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.030756 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.031217 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.031644 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.038274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-885f2032-9772-4f10-9d25-d128f73cb61c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.240937 Aug 17 20:24:18.040600 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 186/368] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:17 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:18.182591 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:18.190507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-afbea260-1153-4678-853b-009960d68ecb tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.173072 Aug 17 20:24:18.191156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 183/369] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:18 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:18.246276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:18.246928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:18.253298 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.253820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.254264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.255083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.255546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.255977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.260728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:18.261345 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:18.267241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.267723 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.268158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.268986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.269302 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.269722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.469256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:18.479240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c1a7c6ce-2316-4a20-a662-45a503b0ffac tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.237486 Aug 17 20:24:18.479889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 187/370] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:18 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:18.484401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:18.484717 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:18.485340 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:18.492370 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.492949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.493338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.494084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:18.494541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:18.495002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:18.495824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2501e84e-7922-498a-8f4d-4fae10488e68 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.239161 Aug 17 20:24:18.496525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 184/371] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:18 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:18.640927 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:18.650130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3563ccae-fc39-4ef5-9fc3-e230c46a640d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.169152 Aug 17 20:24:18.650750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 188/372] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:18 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:19.037894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:19.038683 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:19.044892 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.045372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.045798 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.046482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.047024 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.047447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.067773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:19.068527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:19.075562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.076051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.076576 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.077284 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.077741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.078169 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.256453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:19.264781 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bacbf9ff-d9fd-4fde-ae16-248f8a0d6132 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.230833 Aug 17 20:24:19.265360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 185/373] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:19 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:19.270218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:19.272472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:19.279077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:19.281125 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.281616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.282074 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.282808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.283267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.283685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.287428 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b7d41a09-73f3-43f8-9471-511c71a763a3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.223577 Aug 17 20:24:19.306334 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 189/374] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:19 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:19.470753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:19.490671 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3a9fc25a-1498-4ff9-9ee4-0178f6d8b665 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.222784 Aug 17 20:24:19.503136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:19.513723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:19.513870 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 186/375] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:19 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:19.513969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.513969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.513969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.514385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.514895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.515389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.528293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:19.531451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:19.558332 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.559270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.562071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.563374 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:19.572024 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:19.572939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:19.945489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:19.970939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d2e765fd-f0bc-42d2-a389-c0bc109ba39d tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1471 microversion: 2.1 time: 0.472719 Aug 17 20:24:19.977811 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:19.986420 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2d66ba41-8586-4e18-82c8-e4b981436a6e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.471105 Aug 17 20:24:20.000830 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 187/376] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:19 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:20.003624 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 190/377] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:19 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1471 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:20.006567 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:20.007209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:20.015640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.016143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.016580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.017590 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.018050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.018476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.227543 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:20.237414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-260f21e4-3abb-462b-96b8-0ac272d3f71b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.235309 Aug 17 20:24:20.238031 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 188/378] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:20 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:20.287472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:20.288086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:20.310426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.311111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.311601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.312538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.313011 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.313453 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.315778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:20.316540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:20.325596 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.326101 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.326587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.332784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.332784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.332784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.611797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:20.629044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-10ca3a99-520c-4fb4-9b9e-9f166288829f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.345330 Aug 17 20:24:20.639293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 191/379] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:20 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:20.642503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:20.656559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-86cfd85f-3527-41e1-9960-8898db0db5b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.346306 Aug 17 20:24:20.657467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 189/380] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:20 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:20.662397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:20.662987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:20.670957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.671456 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.671900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.672630 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.673096 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.673523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.683532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-90902cbc-7b26-45f9-8daf-7b908e81b6c1 req-553f0c73-789e-41e7-b749-1bbddbf6cbde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "875e6560-14af-4e70-8a8a-b6ddb6de1f7c", "name": "network-vif-deleted", "tag": "0b783e0f-a846-4151-adac-9ee5a948ad60"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:20.705522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-90902cbc-7b26-45f9-8daf-7b908e81b6c1 req-553f0c73-789e-41e7-b749-1bbddbf6cbde service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:20.706245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-90902cbc-7b26-45f9-8daf-7b908e81b6c1 req-553f0c73-789e-41e7-b749-1bbddbf6cbde service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:20.707358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-90902cbc-7b26-45f9-8daf-7b908e81b6c1 req-553f0c73-789e-41e7-b749-1bbddbf6cbde service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:20.726752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-90902cbc-7b26-45f9-8daf-7b908e81b6c1 req-553f0c73-789e-41e7-b749-1bbddbf6cbde service nova] Creating event network-vif-deleted:0b783e0f-a846-4151-adac-9ee5a948ad60 for instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c on hv-cinder-83538 Aug 17 20:24:20.733578 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-90902cbc-7b26-45f9-8daf-7b908e81b6c1 req-553f0c73-789e-41e7-b749-1bbddbf6cbde service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081440 Aug 17 20:24:20.734570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 192/381] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:20.857905 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:20.867495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c893c35b-e881-4377-8453-356e4575db9c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.209139 Aug 17 20:24:20.881542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 190/382] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:20 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:21.011021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:21.011462 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:21.012166 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:21.012318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:21.021795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.022287 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.022460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.022817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.023979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.024096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.024191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.024282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.024655 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.025402 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.025900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.026335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.130762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:21.143694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-293bf3f6-a8d8-4407-a582-35925edfc99f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1429 microversion: 2.1 time: 0.138830 Aug 17 20:24:21.144661 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 193/383] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:21 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1429 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:21.224835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:21.233043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2af797ee-d685-4adc-9f80-faa0f1647d60 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.227695 Aug 17 20:24:21.233645 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 191/384] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:21 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:21.259513 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:21.260127 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:21.273735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.274498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.275408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.276421 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.276901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.277339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.461066 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:21.469151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b4a182f3-dc28-4825-be3d-fcfc312457a7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.214103 Aug 17 20:24:21.469954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 194/385] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:21 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:21.653826 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:21.654451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:21.660708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.661190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.661620 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.665207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.665207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.665207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.686347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:21.686997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:21.698829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.698829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.698829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.699791 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:21.700261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:21.700695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:21.971694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:21.993887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:21.996940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6b3a7b58-bf82-46cd-b64e-902b6d30d6b0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.346484 Aug 17 20:24:21.998222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 192/386] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:21 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:22.006178 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:22.007314 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:22.014950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.015617 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.016414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.017475 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.018071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.018718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.024002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dddbd393-ec05-405a-9af2-8c82588c54bb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.340683 Aug 17 20:24:22.024501 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 195/387] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:21 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:22.166301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:22.167263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:22.174338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.174988 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.175423 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.176451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.177055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.177654 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.206199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:22.218007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c2a80f7f-611a-4c66-955d-1a342215403e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.218168 Aug 17 20:24:22.232516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 193/388] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:21 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:22.260462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:22.262317 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:22.263511 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:22.268720 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0f3ba851-5a2b-4e42-808e-889127ceb796 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1429 microversion: 2.1 time: 0.107656 Aug 17 20:24:22.270889 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.271588 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.272182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.273769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.274451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.275078 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.279109 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 196/389] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:22 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1429 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:22.447132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:22.455290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-23318ab9-22d3-4a9f-9e5a-6f4a6f1166cf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.198518 Aug 17 20:24:22.455856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 194/390] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:22 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:22.489996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:22.491091 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:22.493843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:22.499686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.500313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.501007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.502065 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:22.502608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:22.503155 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:22.657261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:22.666854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-864f6743-0be3-4a93-a623-47a245adb722 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.181074 Aug 17 20:24:22.668286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 197/391] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:22 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:23.019088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:23.019778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:23.026549 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.027073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.027513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.028214 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.028673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.029133 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.066495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:23.067663 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:23.078867 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.080089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.081210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.083130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.084364 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.085353 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.232206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:23.234771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:23.241885 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f93f1181-9a22-4630-996e-6d77f308f8e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.226055 Aug 17 20:24:23.242551 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 195/392] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:23 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:23.264060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:23.265376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:23.271946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.272761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.273395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.274832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.275939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.276565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.294140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:23.308592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1b94fd82-b36e-4a6a-b1a2-0532d4075728 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.250146 Aug 17 20:24:23.309184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 198/393] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:23 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:23.314944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:23.315947 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:23.323913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.324742 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.337839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.338985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.345547 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.346344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.517948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:23.517948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-38eaf054-aa68-43b1-b8b5-fe492a6be4d4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1429 microversion: 2.1 time: 0.160712 Aug 17 20:24:23.517948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 199/394] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:23 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1429 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:23.517948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:23.519195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:23.519195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.519195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.519195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.519535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.519535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.519535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.519776 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:23.519776 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4e83a9e7-f3ca-4dc2-8793-fcdc49846149 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.254032 Aug 17 20:24:23.519776 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 196/395] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:23 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:23.697502 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:23.698132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:23.698359 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:23.705818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.706406 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.706949 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.707821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:23.708375 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:23.708870 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:23.710280 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3c7e4d00-6ce9-4876-8d17-14d28b5ebb24 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.236541 Aug 17 20:24:23.711595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 200/396] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:23 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:24.181025 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:24.191028 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9de01171-1cd6-43b2-bca1-1f68f932479c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.498866 Aug 17 20:24:24.192248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 197/397] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:23 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:24.267824 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:24.268548 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:24.276892 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.277390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.277836 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.278567 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.279075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.279535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.361379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:24.361379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:24.361379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.361379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.363272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.363272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.363272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.363272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.463763 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:24.470669 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:24.474399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-93e61f73-3742-4638-bc69-0727104ff695 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.211444 Aug 17 20:24:24.478406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 201/398] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:24 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:24.510203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:24.511181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:24.525552 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.526875 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.527546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.528523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.529208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.529825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.625536 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:24.634682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-734ff257-d997-48a0-8079-3fb8560d05e9 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1429 microversion: 2.1 time: 0.129151 Aug 17 20:24:24.635666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 202/399] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:24 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1429 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:24.654685 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:24.655649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:24.662123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.662948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.663987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.665086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.665767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.666401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.706012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:24.715454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-16140a7a-651b-43f4-af4f-10b43c7feae8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.377371 Aug 17 20:24:24.716659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 198/400] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:24 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:24.734441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:24.735101 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:24.748167 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.749768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.750605 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.752306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:24.753242 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:24.753992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:24.867617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:24.877141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ec9ba51d-fdf0-46fb-9a57-a0fc62e0995d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.226456 Aug 17 20:24:24.878071 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 203/401] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:24 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:24.955360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:24.966232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6010aec6-82fa-426b-be09-b3f9bef4d307 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.237693 Aug 17 20:24:24.969721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 199/402] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:24 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:25.216917 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:25.218112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:25.230471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.235310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.235310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.235310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.235310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.235737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.416959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:25.431998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c4bec869-a487-4dd6-b1e4-178a80a25201 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.221683 Aug 17 20:24:25.434506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 204/403] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:25 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:25.512748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:25.513433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:25.520896 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.521394 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.521838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.523443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.523975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.524413 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.661033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:25.662196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:25.676268 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.677230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.678035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.680510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.681442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.682241 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.706930 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:25.724886 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a6614a83-b768-4666-9260-9f09b965d901 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.216161 Aug 17 20:24:25.734864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 200/404] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:25 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:25.743198 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:25.743888 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:25.750923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.751411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.752097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.753007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.753685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.754110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.823953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:25.842359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-60aecc96-323e-4efd-b9e2-3addda8af5b4 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1429 microversion: 2.1 time: 0.188947 Aug 17 20:24:25.851376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 205/405] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:25 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1429 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:25.901088 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:25.901770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:25.909395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.910248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.911162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.912418 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:25.913303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:25.914379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:25.971609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:25.983082 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2708cb14-0f87-4a62-9e02-d2e08d16ba50 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.244273 Aug 17 20:24:25.984279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 201/406] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:25 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:26.002269 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:26.002998 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:26.016493 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.017298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.017817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.018570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.019750 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.020826 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.171110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:26.180826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b4dfc861-ed2b-4add-baca-261db302041f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.284143 Aug 17 20:24:26.182023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 206/407] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:25 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:26.217626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:26.229093 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-82c52ad0-76ee-4c90-890d-edcebbaad906 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.243244 Aug 17 20:24:26.230683 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 202/408] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:25 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:26.454140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:26.454805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:26.462182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.462965 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.463589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.464598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.465282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.465967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.637182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:26.645491 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2e24e0d8-370a-44a1-a262-711fa4fbaab3 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.195030 Aug 17 20:24:26.657432 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 207/409] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:26 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:26.747363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:26.748979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:26.755156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.755653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.756097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.756895 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.757869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.757869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.865310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:26.866156 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:26.874476 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.875447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.876249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.877773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:26.879094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:26.879490 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:26.957364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:26.966114 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6271036a-2b6f-43ab-b9e6-2d98f00c78e4 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.222942 Aug 17 20:24:26.966706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 203/410] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:26 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:26.977313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:26.987543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6f745551-13be-4019-95df-eac2554848ae tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1429 microversion: 2.1 time: 0.126159 Aug 17 20:24:26.988139 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 208/411] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:26 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1429 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:27.021348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:27.022070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:27.041351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.041842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.042278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.043260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.043563 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.043986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.206814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:27.216864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:27.217898 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:27.219467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-45e28fc0-0b43-4bb8-bd44-019582e26d4d tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.202741 Aug 17 20:24:27.220666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 204/412] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:27 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:27.227154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.227817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.228363 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.234806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.234806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.234806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.254238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:27.255244 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:27.264331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.264331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.264331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.265322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.266104 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.266948 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.468244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:27.475625 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b8520339-fe42-4aa2-bcb5-609b3ce67ea4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.264278 Aug 17 20:24:27.476568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 209/413] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:27 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:27.485944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:27.494209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-037ae26c-a946-4f11-b88e-066a202b73a8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.246275 Aug 17 20:24:27.494880 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 205/414] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:27 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:27.667911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:27.668573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:27.674937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.675435 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.675872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.676678 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.677136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.677562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.819105 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:27.827739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c0c52e69-1e5b-42f1-b9ff-4f772e601fee tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.163767 Aug 17 20:24:27.828328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 210/415] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:27 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:27.988379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:27.988965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:27.995508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.996038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.996477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:27.997186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:27.997637 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:27.998067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.009143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:28.009856 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:28.016668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.018385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.018385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.018385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.018807 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.019275 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.103069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:28.111735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-10fb05b5-9870-45d1-9a0a-487b8dd4feb6 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1429 microversion: 2.1 time: 0.106842 Aug 17 20:24:28.112554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 211/416] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:28 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1429 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:28.166030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:28.174353 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9bdb30e7-5715-4b69-a6ce-60f942953506 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.190070 Aug 17 20:24:28.174991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 206/417] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:27 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:28.245379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:28.245994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:28.252897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.253403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.253847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.254556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.255045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.255476 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.461635 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:28.482519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b645803c-d321-4220-a475-cc00ca63d1d3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1709 microversion: 2.1 time: 0.242116 Aug 17 20:24:28.485209 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 212/418] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:28 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1709 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:28.497242 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:28.497792 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:28.504942 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.505755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.506082 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.507006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.507480 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.509411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.515061 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:28.515785 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:28.524671 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.530051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.530051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.530051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.530051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.530438 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.743624 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:28.757251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8d02e808-6626-4672-b4fc-84feeb82817d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.263495 Aug 17 20:24:28.757910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:28.766579 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-997c3e73-790d-4852-98bd-ea8cdfdf3ee3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.255473 Aug 17 20:24:28.770294 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 207/419] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:28 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:28.771103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 213/420] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:28 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:28.850519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:28.851915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:28.858422 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.858996 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.859438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:28.860147 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:28.860601 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:28.861018 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.045799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:29.053743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e9b3e9ee-04db-44d1-a892-b26535c362ed tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.209237 Aug 17 20:24:29.054446 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 208/421] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:28 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:29.143075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:29.143709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:29.151697 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.152196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.152632 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.153390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.153844 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.154266 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.197063 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:29.197679 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:29.203997 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.204477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.204910 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.205603 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.206050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.206477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.225292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:29.233337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b453bbbb-eceb-4da3-aaaf-5b0940d08f30 tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1300 microversion: 2.1 time: 0.094182 Aug 17 20:24:29.234160 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 214/422] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:29 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:29.366171 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:29.374588 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2d6f05f7-8dd8-45e4-a9be-0bb225af94c1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.182171 Aug 17 20:24:29.382898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 209/423] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:29 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:29.506698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:29.507330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:29.513906 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.514399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.514948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.515641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.516100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.516531 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.686355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:29.696006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-97c89c8b-593f-4e17-9864-0923c0ade5fd tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1713 microversion: 2.1 time: 0.193175 Aug 17 20:24:29.696712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 215/424] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:29 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1713 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:29.775084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-9cde8ce4-e9b8-46ad-a2ba-719c8b6209cc req-1ac73324-1f2c-4d98-a4f0-7d2205f778ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "618e1ab8-0237-465a-820f-b0886789b9d3", "tag": "2f52609a-2602-478e-82f6-9857e1154033"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:29.780068 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:29.780850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:29.788799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.792457 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.792457 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.792457 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.792457 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.792878 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.796655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9cde8ce4-e9b8-46ad-a2ba-719c8b6209cc req-1ac73324-1f2c-4d98-a4f0-7d2205f778ce service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.797968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9cde8ce4-e9b8-46ad-a2ba-719c8b6209cc req-1ac73324-1f2c-4d98-a4f0-7d2205f778ce service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.797968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9cde8ce4-e9b8-46ad-a2ba-719c8b6209cc req-1ac73324-1f2c-4d98-a4f0-7d2205f778ce service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.813488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-9cde8ce4-e9b8-46ad-a2ba-719c8b6209cc req-1ac73324-1f2c-4d98-a4f0-7d2205f778ce service nova] Creating event network-changed:2f52609a-2602-478e-82f6-9857e1154033 for instance 618e1ab8-0237-465a-820f-b0886789b9d3 on hv-cinder-83538 Aug 17 20:24:29.819782 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-9cde8ce4-e9b8-46ad-a2ba-719c8b6209cc req-1ac73324-1f2c-4d98-a4f0-7d2205f778ce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048506 Aug 17 20:24:29.820761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 210/425] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:29.826181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:29.826924 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:29.834863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.836083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.838419 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:29.839228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:29.839715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:29.840145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:30.005142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:30.015273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-551999d0-ee7e-481d-bb98-b4806ee39f51 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.240242 Aug 17 20:24:30.027978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 216/426] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:29 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:30.038424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:30.046912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-353e7bdb-e0a5-4260-a8a1-1fae5430d175 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.224814 Aug 17 20:24:30.047608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 211/427] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:29 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:30.073865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:30.074487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:30.080924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:30.081396 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:30.081834 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:30.082673 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:30.083135 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:30.083562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:30.222502 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:30.231461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-eb5611f9-7825-4957-89b1-a34fb1d1221f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.161461 Aug 17 20:24:30.232312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 217/428] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:30 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:30.256123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:30.257297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:30.266051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:30.266954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:30.267747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:30.269012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:30.269843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:30.270610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:30.379921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:30.389558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2a206b84-9ab3-44f6-9fb3-f9c1899b185f tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1300 microversion: 2.1 time: 0.138593 Aug 17 20:24:30.397108 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:30.398826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:30.402841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 212/429] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:30 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1300 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:30.415597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:30.416440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:30.417282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:30.418572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:30.419100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:30.419902 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:30.437580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:30.612112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:30.631041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-83b69be3-8d6c-4262-bdc5-a486dbe6d51b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1370 microversion: 2.1 time: 0.237877 Aug 17 20:24:30.632470 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 218/430] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:30 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1370 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:31.043110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:31.043945 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:31.051121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.052182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.052182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.052748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.053207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.054214 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.057485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:31.078151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:31.079304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:31.090928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.090928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.091519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.092578 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.093405 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.094012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.488919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:31.510431 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-790e3d25-6bf0-47e9-9d1c-3de78999416a tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.474871 Aug 17 20:24:31.515304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 213/431] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:31 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:31.527431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:31.540357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c26122b0-43d6-47a4-9acd-9b56463be862 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.475043 Aug 17 20:24:31.557309 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 219/432] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:31 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:31.558121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:31.559535 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:31.563280 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:31.569488 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:31.576530 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.577850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.578775 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.580296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.581824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.583232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.584094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.585357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.586296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.587943 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.588747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.589472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.655000 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.655493 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.655939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.656395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lazy-loading 'fault' on Instance uuid 875e6560-14af-4e70-8a8a-b6ddb6de1f7c {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:24:31.746669 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:31.762315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-15fce795-21b1-44ed-80f0-c89d1521961e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1305 microversion: 2.1 time: 0.203415 Aug 17 20:24:31.763461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 220/433] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:31 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1305 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:31.773099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:31.774221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:31.785289 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.786162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.786989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.788887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.789783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.790549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.793608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:31.803589 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9991a2a6-890a-41c9-9221-2371b74b964e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.282954 Aug 17 20:24:31.805306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 214/434] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:31 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:31.838036 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-c28fe5e3-8a68-4a8a-a043-37d53388adbf req-750cabde-2ee9-4220-b32b-08277d33c294 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e3ec09-78c6-4fcf-9fac-045735e18468", "tag": "f0e62279-9fc9-42ea-903e-170912670383"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:31.843409 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:31.851333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c28fe5e3-8a68-4a8a-a043-37d53388adbf req-750cabde-2ee9-4220-b32b-08277d33c294 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:31.852370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c28fe5e3-8a68-4a8a-a043-37d53388adbf req-750cabde-2ee9-4220-b32b-08277d33c294 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:31.852799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c28fe5e3-8a68-4a8a-a043-37d53388adbf req-750cabde-2ee9-4220-b32b-08277d33c294 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:31.871939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-c28fe5e3-8a68-4a8a-a043-37d53388adbf req-750cabde-2ee9-4220-b32b-08277d33c294 service nova] Creating event network-changed:f0e62279-9fc9-42ea-903e-170912670383 for instance 74e3ec09-78c6-4fcf-9fac-045735e18468 on hv-cinder-83538 Aug 17 20:24:31.877821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-c28fe5e3-8a68-4a8a-a043-37d53388adbf req-750cabde-2ee9-4220-b32b-08277d33c294 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044818 Aug 17 20:24:31.878864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 215/435] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:24:32.168518 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:32.176523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7ca941b4-d8d2-45d1-92c8-df117bf38aa2 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1564 microversion: 2.1 time: 0.411424 Aug 17 20:24:32.177108 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 221/436] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:31 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1564 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:32.199238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:32.199960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:32.206663 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.207225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.207748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.208503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.208999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.209456 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.313415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ea125b2f-d393-4c93-806d-b06d0c0d92c3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119172 Aug 17 20:24:32.314143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 216/437] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:24:32 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:32.564693 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:32.565907 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:32.566773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:32.567809 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:32.576788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.577569 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.578354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.579648 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.579787 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.580179 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.580622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.580867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.581339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.581685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.581819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.582210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.858393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:32.866143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cc4936e4-26ec-461d-bb95-53ce363c6881 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.304862 Aug 17 20:24:32.866734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 217/438] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:32 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:32.885680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-647e6a0a-789b-4810-87df-a2f43d51abda req-0789f06f-26c8-4fc5-af0c-4922df219269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a86ddd-90d5-466f-8a34-6cc8d6d30690", "name": "network-vif-plugged", "status": "completed", "tag": "552f575e-1f5c-477e-8e14-8836c2be669b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:32.896009 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-647e6a0a-789b-4810-87df-a2f43d51abda req-0789f06f-26c8-4fc5-af0c-4922df219269 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.896496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-647e6a0a-789b-4810-87df-a2f43d51abda req-0789f06f-26c8-4fc5-af0c-4922df219269 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.896922 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-647e6a0a-789b-4810-87df-a2f43d51abda req-0789f06f-26c8-4fc5-af0c-4922df219269 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.900530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:32.909072 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ce117c3c-e631-4f3e-83a1-1f2d2193d027 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.351975 Aug 17 20:24:32.909655 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 222/439] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:32 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:32.916771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:32.917392 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:32.926692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.927762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.929931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-647e6a0a-789b-4810-87df-a2f43d51abda req-0789f06f-26c8-4fc5-af0c-4922df219269 service nova] Creating event network-vif-plugged:552f575e-1f5c-477e-8e14-8836c2be669b for instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 on hv-cinder-83538 Aug 17 20:24:32.934018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.935215 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.936468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.938195 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-647e6a0a-789b-4810-87df-a2f43d51abda req-0789f06f-26c8-4fc5-af0c-4922df219269 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055770 Aug 17 20:24:32.938317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.938428 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 218/440] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:32.953275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:32.955366 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:32.965684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.966341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.966928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.968575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.969527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.970092 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.985998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:32.986716 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:32.987751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:32.988230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lazy-loading 'fault' on Instance uuid 875e6560-14af-4e70-8a8a-b6ddb6de1f7c {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:24:33.053154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '70aa263746b248508aa2c4f844c56d40', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f0c454fc4f14e7cb33582566d510164', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:33.061691 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6798a32a-013e-4dc7-b47e-86fefeee66ce tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 200 len: 1305 microversion: 2.1 time: 0.149984 Aug 17 20:24:33.062718 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 223/441] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:32 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 1305 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:33.283071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:33.301164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8f38c780-8578-4aea-be8b-ceba3d69a8c7 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.359799 Aug 17 20:24:33.302290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 219/442] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:32 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:33.891307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:33.892043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:33.899856 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:33.900338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:33.900771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:33.901465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:33.901915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:33.902738 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:33.942025 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:33.943243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:33.954215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:33.954898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:33.955605 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:33.956564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:33.957270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:33.957920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:34.120510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:34.130566 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c1f178e1-db8e-4f08-a8b3-2921e8ebfcd8 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.243349 Aug 17 20:24:34.131207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 224/443] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:33 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:34.151801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:34.152321 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] [instance: 875e6560-14af-4e70-8a8a-b6ddb6de1f7c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:34.158845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:34.159347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:34.159783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:34.160731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:34.161197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:34.161613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:34.164456 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:34.173081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5a8a23ff-b883-4810-81ac-8ad3c5e70482 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.236586 Aug 17 20:24:34.174181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 220/444] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:33 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:34.179200 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] HTTP exception thrown: Instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c could not be found. Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Request method failure captured: Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c HTTP/1.1 Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U5IiDdbjCK-wqL6Keg6rethuZwer4nLCRPp-yARd_n5mm4eDQn8vDwRrH3xtbV_qi243NGtRF5t7HIUHuLY4jL2g3q9xPxR2vpRcNByNS-1flBrBaP8CIERh6-ra7lvM5sYTiuGNKNFY38nNo72HyrxSVW3rpX3jR1qy6BPr8jRPlg Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 5f0c454fc4f14e7cb33582566d510164 Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesNegativeTest-734202998 Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:24:34.181433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5f0c454fc4f14e7cb33582566d510164"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5f0c454fc4f14e7cb33582566d510164"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5f0c454fc4f14e7cb33582566d510164"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5f0c454fc4f14e7cb33582566d510164"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesNegativeTest-734202998 Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 5f0c454fc4f14e7cb33582566d510164 Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesNegativeTest-734202998 Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesNegativeTest-734202998-project Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 70aa263746b248508aa2c4f844c56d40 Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesNegativeTest-734202998-project Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c could not be found. Aug 17 20:24:34.183007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '875e6560-14af-4e70-8a8a-b6ddb6de1f7c'} Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c could not be found. Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:24:34.184003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c could not be found. Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c could not be found. Aug 17 20:24:34.185394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:24:34.189091 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] Returning 404 to user: Instance 875e6560-14af-4e70-8a8a-b6ddb6de1f7c could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:24:34.190037 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7d8e89b3-79fe-4d16-bc14-098408ed6c7e tempest-VolumesNegativeTest-734202998 tempest-VolumesNegativeTest-734202998-project] 10.222.0.64 "GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c" status: 404 len: 111 microversion: 2.1 time: 0.057613 Aug 17 20:24:34.191639 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 225/445] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:34 2022] GET /compute/v2.1/servers/875e6560-14af-4e70-8a8a-b6ddb6de1f7c => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:24:34.245124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-783c0f91-eeea-42e1-8f6f-7cf48bf8e780 req-c6261114-2ca0-49e5-84e3-64ab4a2963dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb5faa-99aa-4e6a-9d28-c82d7c47222d", "tag": "161d7ebe-907f-42da-9379-adf417700bb6"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:34.258158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-783c0f91-eeea-42e1-8f6f-7cf48bf8e780 req-c6261114-2ca0-49e5-84e3-64ab4a2963dc service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:34.259387 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-783c0f91-eeea-42e1-8f6f-7cf48bf8e780 req-c6261114-2ca0-49e5-84e3-64ab4a2963dc service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:34.259687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-783c0f91-eeea-42e1-8f6f-7cf48bf8e780 req-c6261114-2ca0-49e5-84e3-64ab4a2963dc service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:34.276931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-783c0f91-eeea-42e1-8f6f-7cf48bf8e780 req-c6261114-2ca0-49e5-84e3-64ab4a2963dc service nova] Creating event network-changed:161d7ebe-907f-42da-9379-adf417700bb6 for instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d on hv-cinder-83538 Aug 17 20:24:34.282312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-783c0f91-eeea-42e1-8f6f-7cf48bf8e780 req-c6261114-2ca0-49e5-84e3-64ab4a2963dc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041650 Aug 17 20:24:34.283612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 221/446] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:24:34.338207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:34.338895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:34.344970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:34.345465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:34.345905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:34.346651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:34.347099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:34.347623 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:34.809973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:34.819592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1119847e-0ca5-412f-8b32-00820719125d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.484725 Aug 17 20:24:34.832959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 226/447] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:34 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:35.161430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:35.162836 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:35.171025 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:35.171821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:35.172434 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:35.173313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:35.173920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:35.174547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:35.196519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:35.198164 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:35.205689 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:35.206173 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:35.206706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:35.207523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:35.208194 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:35.208845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:35.439975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:35.449046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c0f63754-8b9b-4ef8-881e-4ad33bf985a7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.295328 Aug 17 20:24:35.449560 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 222/448] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:35 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:35.471427 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:35.495288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-35ddff70-f0f9-45d6-be14-9391d51f12fd tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.304172 Aug 17 20:24:35.514076 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 227/449] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:35 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:35.840469 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:35.841684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:35.848856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:35.849354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:35.849785 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:35.851587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:35.852170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:35.852606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.066375 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:36.076755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a4031476-2549-44e3-a403-82914034bcea tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.240391 Aug 17 20:24:36.077379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 223/450] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:35 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:36.471816 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:36.472456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:36.482493 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:36.483423 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:36.484133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.485408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:36.486232 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:36.487041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.544221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:36.544978 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:36.551382 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:36.552020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:36.556995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.556995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:36.556995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:36.556995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.723019 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:36.750071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:36.754934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4e1ddeae-2e1d-4603-aabc-96592f316880 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1258 microversion: 2.1 time: 0.287152 Aug 17 20:24:36.760731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5958f3c7-0088-478f-a550-a7707d5aaf62 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.221312 Aug 17 20:24:36.762275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 224/451] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:36 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:36.767072 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 228/452] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:36 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1258 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:36.820467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:36.821002 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:36.821988 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-fd7f591f-ef86-4dba-b2dc-026c23e92abd req-fea38bfc-b354-4019-87e1-e6c6264773fb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e3ec09-78c6-4fcf-9fac-045735e18468", "name": "network-vif-plugged", "status": "completed", "tag": "f0e62279-9fc9-42ea-903e-170912670383"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:36.832554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-fd7f591f-ef86-4dba-b2dc-026c23e92abd req-fea38bfc-b354-4019-87e1-e6c6264773fb service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:36.833058 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-fd7f591f-ef86-4dba-b2dc-026c23e92abd req-fea38bfc-b354-4019-87e1-e6c6264773fb service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:36.833307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:36.833713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-fd7f591f-ef86-4dba-b2dc-026c23e92abd req-fea38bfc-b354-4019-87e1-e6c6264773fb service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.833823 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:36.834237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.836706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:36.837829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:36.838721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:36.847860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-fd7f591f-ef86-4dba-b2dc-026c23e92abd req-fea38bfc-b354-4019-87e1-e6c6264773fb service nova] Creating event network-vif-plugged:f0e62279-9fc9-42ea-903e-170912670383 for instance 74e3ec09-78c6-4fcf-9fac-045735e18468 on hv-cinder-83538 Aug 17 20:24:36.853360 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-fd7f591f-ef86-4dba-b2dc-026c23e92abd req-fea38bfc-b354-4019-87e1-e6c6264773fb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036304 Aug 17 20:24:36.861398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 229/453] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:36.867736 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ca04f45f-0f02-4d5e-becc-9c3209911a8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/ips" status: 200 len: 152 microversion: 2.20 time: 0.055726 Aug 17 20:24:36.873931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 225/454] 10.222.0.64 () {60 vars in 1289 bytes} [Wed Aug 17 20:24:36 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/ips => generated 152 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:24:37.100038 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:37.101014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:37.108398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:37.108940 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:37.109380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:37.110131 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:37.110591 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:37.111081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:37.266443 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:37.274307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1c078e30-e085-433c-ab18-99b2ee536d91 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.178761 Aug 17 20:24:37.274913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 230/455] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:37 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:37.777653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:37.778868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:37.783809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:37.785237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:37.786503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:37.787326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:37.789055 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:37.790483 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:37.791379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:37.791916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:37.796069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:37.800244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:37.800991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:37.802135 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:37.802994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:37.804188 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:38.011483 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:38.020908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a72acf70-0391-458e-8fc2-c7c73a897286 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1441 microversion: 2.1 time: 0.246954 Aug 17 20:24:38.033711 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:38.035719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 226/456] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:37 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1441 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:38.042905 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:38.043460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:38.048014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2f2d72f7-91ab-4d45-8936-f36e1b25ecf3 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.268856 Aug 17 20:24:38.048723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 231/457] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:37 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:38.062982 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:38.063484 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:38.063923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:38.064715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:38.065176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:38.065595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:38.220509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:38.229188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9cbb23bd-4333-47af-893c-63086d2638aa tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1441 microversion: 2.1 time: 0.190150 Aug 17 20:24:38.230083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 227/458] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:38 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1441 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:38.296708 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:38.299136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:38.304954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:38.305469 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:38.305913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:38.306658 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:38.307296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:38.307919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:38.485656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:38.494801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f9ab676f-6c8e-431c-91d1-a9e8c9091f70 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.203046 Aug 17 20:24:38.495724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 232/459] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:38 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:24:39.068989 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:39.070066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:39.076564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:39.077061 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:39.077491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:39.078183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:39.078719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:39.079074 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:39.313572 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:39.324746 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-38fca539-6bd4-4ed1-b30c-2078f1523600 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1359 microversion: 2.1 time: 0.259554 Aug 17 20:24:39.325350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 228/460] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:39 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:39.405720 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:39.406365 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:39.414886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:39.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:39.416413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:39.417624 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:39.418421 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:39.419084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:39.448089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lazy-loading 'flavor' on Instance uuid 43150116-1ad7-4a0c-b292-98ee4307770d {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:24:39.516803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:39.517508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:39.526450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:39.526976 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:39.527582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:39.528481 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:39.529100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:39.529676 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:39.783115 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:39.878322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:39.888752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dcdbaf18-2553-4ff7-8851-a8ce2d10357a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.376176 Aug 17 20:24:39.902655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 229/461] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:39 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:40.035997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a678760c-7d5b-40aa-81a5-2e5a53dff5ab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/action" status: 202 len: 0 microversion: 2.20 time: 0.634491 Aug 17 20:24:40.036864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 233/462] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 17 20:24:39 2022] POST /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/action => generated 0 bytes in 637 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:24:40.047257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:40.049436 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:40.063296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.064298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.065084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:40.065987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.066965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.067862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:40.328141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:40.337070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:40.338571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:40.339745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b7fbcd9e-db51-4148-b265-e24b2377b249 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.297994 Aug 17 20:24:40.340395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 230/463] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:40 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:40.348164 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:40.348869 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:40.356518 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.357010 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.357451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:40.358150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.358606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.360658 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:40.642330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:40.663271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ba04f420-941f-462e-8f0e-e02ca485ab33 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1550 microversion: 2.1 time: 0.318382 Aug 17 20:24:40.664163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 234/464] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:40 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1550 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:40.687990 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:40.688604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:40.695222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.695707 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.696208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:40.696927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.697372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.697793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:40.917526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:40.918694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:40.931779 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.933571 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.933908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:40.936277 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:40.937491 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:40.938591 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.033485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:41.042329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e17b4bbf-c164-486c-bc68-77299b6d6da4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1550 microversion: 2.1 time: 0.358406 Aug 17 20:24:41.042944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 231/465] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:40 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1550 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:41.047856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-2f1301dd-e72f-46ed-9d8a-0d1ca081b2cf req-8d46ad9f-9afb-4ed0-9d34-ce81f46a5552 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618e1ab8-0237-465a-820f-b0886789b9d3", "name": "network-vif-plugged", "status": "completed", "tag": "2f52609a-2602-478e-82f6-9857e1154033"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:41.059252 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-2f1301dd-e72f-46ed-9d8a-0d1ca081b2cf req-8d46ad9f-9afb-4ed0-9d34-ce81f46a5552 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.059747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-2f1301dd-e72f-46ed-9d8a-0d1ca081b2cf req-8d46ad9f-9afb-4ed0-9d34-ce81f46a5552 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.060181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-2f1301dd-e72f-46ed-9d8a-0d1ca081b2cf req-8d46ad9f-9afb-4ed0-9d34-ce81f46a5552 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.075312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-2f1301dd-e72f-46ed-9d8a-0d1ca081b2cf req-8d46ad9f-9afb-4ed0-9d34-ce81f46a5552 service nova] Creating event network-vif-plugged:2f52609a-2602-478e-82f6-9857e1154033 for instance 618e1ab8-0237-465a-820f-b0886789b9d3 on hv-cinder-83538 Aug 17 20:24:41.080611 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-2f1301dd-e72f-46ed-9d8a-0d1ca081b2cf req-8d46ad9f-9afb-4ed0-9d34-ce81f46a5552 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036476 Aug 17 20:24:41.081319 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 232/466] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:41.087236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:41.094270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:41.094270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Searching by: {'deleted': False, 'project_id': '6f2054a9c9ff437c8aceef06d0043526'} {{(pid=121276) get_all /opt/stack/nova/nova/compute/api.py:2964}} Aug 17 20:24:41.101330 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.101719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.102157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.102946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.103403 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.103899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.171973 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:41.218247 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.multi_cell_list [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121276) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 17 20:24:41.323906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bfd1e9a2-7fc6-44bd-9d22-866d66a92eba tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.241376 Aug 17 20:24:41.331300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 233/467] 10.222.0.64 () {58 vars in 1125 bytes} [Wed Aug 17 20:24:41 2022] GET /compute/v2.1/servers => generated 343 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:41.345692 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:41.346711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:41.354316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.354939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.355390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.356478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.356946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.357376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.483251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:41.497141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ebcdcbfa-a2e6-4a5e-8dc7-058bf6f10a83 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.588128 Aug 17 20:24:41.510234 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 235/468] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:40 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:41.516852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:41.517480 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:41.523945 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.524664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.525293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.526694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.527306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.527883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.644843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:41.665107 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0dec98f2-d5e9-4cf3-aefe-5d3d4af75de5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1550 microversion: 2.1 time: 0.323296 Aug 17 20:24:41.670824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 234/469] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:41 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1550 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:41.748552 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:41.760575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:41.762543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:41.764208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ce7c2618-874e-4da6-94ab-0a3f50e98011 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.252879 Aug 17 20:24:41.766266 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 236/470] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:41 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:41.848663 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-c1f77643-d700-4365-935b-b12561d352c5 req-b474b554-ffce-44d0-819b-c20ce3bcc046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a86ddd-90d5-466f-8a34-6cc8d6d30690", "tag": "552f575e-1f5c-477e-8e14-8836c2be669b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:41.869027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c1f77643-d700-4365-935b-b12561d352c5 req-b474b554-ffce-44d0-819b-c20ce3bcc046 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:41.871990 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c1f77643-d700-4365-935b-b12561d352c5 req-b474b554-ffce-44d0-819b-c20ce3bcc046 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:41.872787 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c1f77643-d700-4365-935b-b12561d352c5 req-b474b554-ffce-44d0-819b-c20ce3bcc046 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:41.898828 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-c1f77643-d700-4365-935b-b12561d352c5 req-b474b554-ffce-44d0-819b-c20ce3bcc046 service nova] Creating event network-changed:552f575e-1f5c-477e-8e14-8836c2be669b for instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 on hv-cinder-83538 Aug 17 20:24:41.903368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-c1f77643-d700-4365-935b-b12561d352c5 req-b474b554-ffce-44d0-819b-c20ce3bcc046 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058779 Aug 17 20:24:41.904235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 235/471] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:24:42.519299 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:42.519917 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:42.536964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:42.538207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:42.538793 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:42.540634 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:42.541254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:42.541795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:42.759128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:42.777913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-49252e50-e1cf-4e76-b901-2116ce812b9c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1319 microversion: 2.1 time: 0.262039 Aug 17 20:24:42.778930 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 237/472] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:42 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:42.796466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:42.797899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:42.810765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:42.811523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:42.812244 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:42.813140 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:42.814335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:42.814966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:42.977889 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:42.986155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:42.987685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:42.988939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-60bd2588-0e8e-413c-ba7c-ed1d3588503f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.203096 Aug 17 20:24:42.989500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 236/473] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:42 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:43.813999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:43.815174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:43.823096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:43.823768 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:43.824748 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:43.825767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:43.826426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:43.827323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:43.930765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0003d6c6-4c5f-44c2-a976-f1786a4eb8b8"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:43.933950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:43.940456 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:43.941176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:43.941613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:43.942321 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:43.942967 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:43.943277 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:43.985802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:43.994236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6483b564-50dc-41dc-af6f-0481e95fbd73 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1507 microversion: 2.1 time: 0.185103 Aug 17 20:24:43.994838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 238/474] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:43 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1507 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:44.018523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:44.020602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:44.028055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:44.028656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:44.032766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:44.032766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:44.032766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:44.032766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:44.183722 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:44.199989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:44.199989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:44.199989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-12847357-4742-4a1a-8d11-6480af448405 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.186770 Aug 17 20:24:44.200352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 239/475] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:44 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:45.048843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e8509a2c-17ad-4462-8146-3780e85e476d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.123377 Aug 17 20:24:45.050984 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 237/476] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:24:43 2022] POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments => generated 194 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:45.222860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:45.223391 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:45.230803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:45.231359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:45.231800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:45.232507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:45.233140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:45.233748 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:45.378231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:45.386349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:45.387869 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:45.389021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2447ac05-0a2a-4407-b621-d802c6fd0b78 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.170235 Aug 17 20:24:45.389571 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 240/477] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:45 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:46.416498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:46.417184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:46.423430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:46.423893 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:46.424322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:46.425008 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:46.425456 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:46.425912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:46.565161 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:46.575079 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:46.576550 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:46.577761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-21b4c040-2d5c-4c42-bc73-8408438d0339 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.166445 Aug 17 20:24:46.578305 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 238/478] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:46 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:47.602349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:47.602993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:47.609675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:47.610151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:47.610586 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:47.611341 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:47.611779 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:47.612203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:47.761699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:47.771527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:47.773644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:47.775131 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a33be4d6-8395-43ed-843f-b7c32fdffc5e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.176691 Aug 17 20:24:47.778546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 241/479] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:47 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:48.799988 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:48.800672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:48.807886 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:48.808405 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:48.808846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:48.809562 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:48.810016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:48.810441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:48.947942 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:48.956616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:48.958139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:48.959457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cd55a6e3-e132-4d81-9d74-82d2d267ea1b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.163415 Aug 17 20:24:48.960044 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 239/480] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:48 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:49.982955 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:49.983544 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:49.990533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:49.991344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:49.991883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:49.992601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:49.993057 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:49.993482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:50.147310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:50.156172 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:50.157727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:50.159022 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cc9340e7-eaa4-4238-a8d3-5a56b61b9af2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.180156 Aug 17 20:24:50.159604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 242/481] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:49 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:51.183734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:51.184367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:51.186981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:51.193348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:51.194075 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:51.195677 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:51.196417 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:51.196881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:51.197298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:51.356703 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:51.365243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:51.366938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:51.368180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-edea05ba-3073-4246-9c5f-9a8da70d5461 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.188582 Aug 17 20:24:51.368744 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 240/482] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:51 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:52.393080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:52.393822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:52.403890 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:52.404258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:52.404682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:52.405327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:52.405789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:52.406223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:52.583259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:52.600338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:52.603879 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:52.605481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-51d884a0-eb92-451b-a753-217c3bb32a3e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.216836 Aug 17 20:24:52.606238 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 243/483] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:52 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:53.636527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:53.637248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:53.643748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:53.644250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:53.644689 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:53.645397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:53.645852 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:53.646279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:53.816411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:53.825853 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:53.826511 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:53.827161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:53.827695 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:53.828634 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-79e5c0a0-0242-4c0d-9063-091122ae24ae tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.196082 Aug 17 20:24:53.829195 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 241/484] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:53 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:53.830894 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=98 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:24:53.835126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:53.835616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:53.836106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:53.837018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:53.837467 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:53.838080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:53.977893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:53.986679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4c935b5e-d69f-43a8-93d9-ef407e4fb46f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1596 microversion: 2.1 time: 0.165237 Aug 17 20:24:53.987269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 244/485] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:24:53 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1596 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:24:54.853878 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:54.854709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:54.861677 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:54.862304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:54.862874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:54.863793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:54.864403 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:54.864974 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:55.018712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:55.028067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:55.029697 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:55.031051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bdb1e722-9911-4731-b67a-9ea823342cea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.181931 Aug 17 20:24:55.031625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 242/486] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:54 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:24:56.058143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:56.058143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:56.065124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:56.065803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:56.066307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:56.067214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:56.067816 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:56.068904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:56.255271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:56.265728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:56.267695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:56.269106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5d97e2d4-9284-4442-9019-e0c36f559363 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.217115 Aug 17 20:24:56.269850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 245/487] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:56 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:24:57.294338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a0c345c8-e88f-410a-b469-c86f342ce0f3 req-b8440be6-53d1-42b1-95c5-8c7832ef7446 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e3ec09-78c6-4fcf-9fac-045735e18468", "tag": "f0e62279-9fc9-42ea-903e-170912670383"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:24:57.306865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:57.308200 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:57.322950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a0c345c8-e88f-410a-b469-c86f342ce0f3 req-b8440be6-53d1-42b1-95c5-8c7832ef7446 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:57.330009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:57.330842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:57.331373 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:57.332486 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:57.333294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:57.334534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:57.338610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a0c345c8-e88f-410a-b469-c86f342ce0f3 req-b8440be6-53d1-42b1-95c5-8c7832ef7446 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:57.339881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a0c345c8-e88f-410a-b469-c86f342ce0f3 req-b8440be6-53d1-42b1-95c5-8c7832ef7446 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:57.357297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a0c345c8-e88f-410a-b469-c86f342ce0f3 req-b8440be6-53d1-42b1-95c5-8c7832ef7446 service nova] Creating event network-changed:f0e62279-9fc9-42ea-903e-170912670383 for instance 74e3ec09-78c6-4fcf-9fac-045735e18468 on hv-cinder-83538 Aug 17 20:24:57.367529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a0c345c8-e88f-410a-b469-c86f342ce0f3 req-b8440be6-53d1-42b1-95c5-8c7832ef7446 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080724 Aug 17 20:24:57.368828 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 243/488] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:24:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:24:57.615014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:57.637748 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:57.641994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:57.646692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5b4e0784-9715-4f6b-931d-76eb1ee71d7d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1744 microversion: 2.20 time: 0.344175 Aug 17 20:24:57.663945 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 246/489] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:57 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1744 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:24:58.683080 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:24:58.684457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:24:58.692915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:58.694086 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:58.694983 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:58.696408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:24:58.697329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:24:58.697986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:24:58.955814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:58.980081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:58.986214 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:24:58.987450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3be398fb-e192-4d47-a218-89343f443511 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1744 microversion: 2.20 time: 0.311216 Aug 17 20:24:58.988405 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 244/490] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:24:58 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1744 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:00.012721 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:00.013556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:00.020243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:00.020756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:00.021201 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:00.022018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:00.022473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:00.022938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:00.220101 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:00.230198 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:00.231808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:00.233033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-52599687-38f9-4a3c-9ded-378a434a3e15 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1744 microversion: 2.20 time: 0.224265 Aug 17 20:25:00.233608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 247/491] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:00 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1744 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:00.934117 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-7e74191a-9e64-48fb-a47a-861720aa0843 req-b78ef37e-096b-432f-8c9a-5506ceaef005 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43150116-1ad7-4a0c-b292-98ee4307770d", "name": "network-vif-plugged", "status": "completed", "tag": "450fc8d5-29fd-4e49-8e9e-caca2f42f264"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:00.950946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-7e74191a-9e64-48fb-a47a-861720aa0843 req-b78ef37e-096b-432f-8c9a-5506ceaef005 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:00.951795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-7e74191a-9e64-48fb-a47a-861720aa0843 req-b78ef37e-096b-432f-8c9a-5506ceaef005 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:00.952869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-7e74191a-9e64-48fb-a47a-861720aa0843 req-b78ef37e-096b-432f-8c9a-5506ceaef005 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:00.976536 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-7e74191a-9e64-48fb-a47a-861720aa0843 req-b78ef37e-096b-432f-8c9a-5506ceaef005 service nova] Creating event network-vif-plugged:450fc8d5-29fd-4e49-8e9e-caca2f42f264 for instance 43150116-1ad7-4a0c-b292-98ee4307770d on hv-cinder-83538 Aug 17 20:25:00.985713 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-7e74191a-9e64-48fb-a47a-861720aa0843 req-b78ef37e-096b-432f-8c9a-5506ceaef005 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056201 Aug 17 20:25:00.986385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 245/492] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:25:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:25:01.087986 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2080639136"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:01.089251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:01.096530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:01.096967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:01.097608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:01.098335 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:01.098854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:01.102239 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:01.265385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:01.266575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:01.276318 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:01.276770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:01.277217 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:01.277981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:01.278167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.network.security_group_api [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Adding security group 5fbc29df-ab18-400f-aba1-ca1d7888a4aa to port f0e62279-9fc9-42ea-903e-170912670383 Aug 17 20:25:01.278475 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:01.279118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:01.581178 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:01.595546 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:01.598524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:01.601474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2991292d-9eb0-4d54-b49f-693857c85e10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.343794 Aug 17 20:25:01.607016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 246/493] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:01 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:01.883462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ba9cf8da-51be-41d5-a401-a91c5128a3d5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/action" status: 202 len: 0 microversion: 2.1 time: 0.799697 Aug 17 20:25:01.885915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 248/494] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:25:01 2022] POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:25:01.902523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:01.904656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:01.917965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:01.919692 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:01.921455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:01.923151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:01.925131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:01.926198 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:01.991703 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-aa5007e6-fa06-4765-b56b-8a76b943ea81 req-bb4b73bd-3855-4aa5-b9eb-f8d1f12b7a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e3ec09-78c6-4fcf-9fac-045735e18468", "tag": "f0e62279-9fc9-42ea-903e-170912670383"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:02.017024 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-aa5007e6-fa06-4765-b56b-8a76b943ea81 req-bb4b73bd-3855-4aa5-b9eb-f8d1f12b7a4d service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:02.018480 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-aa5007e6-fa06-4765-b56b-8a76b943ea81 req-bb4b73bd-3855-4aa5-b9eb-f8d1f12b7a4d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:02.020073 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-aa5007e6-fa06-4765-b56b-8a76b943ea81 req-bb4b73bd-3855-4aa5-b9eb-f8d1f12b7a4d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:02.063566 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-aa5007e6-fa06-4765-b56b-8a76b943ea81 req-bb4b73bd-3855-4aa5-b9eb-f8d1f12b7a4d service nova] Creating event network-changed:f0e62279-9fc9-42ea-903e-170912670383 for instance 74e3ec09-78c6-4fcf-9fac-045735e18468 on hv-cinder-83538 Aug 17 20:25:02.092330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-aa5007e6-fa06-4765-b56b-8a76b943ea81 req-bb4b73bd-3855-4aa5-b9eb-f8d1f12b7a4d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107736 Aug 17 20:25:02.094336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 249/495] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:25:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:25:02.346013 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:02.371265 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-50b783da-e1b0-4bc2-b9cf-12dff3cec9d8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1762 microversion: 2.1 time: 0.478338 Aug 17 20:25:02.372454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 247/496] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:01 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1762 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:02.638510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:02.639616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:02.654014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:02.657328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:02.659982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:02.661279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:02.665848 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:02.666336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:03.020841 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:03.035898 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:03.040478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:03.043296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b82749fb-4172-478a-8df4-5dd04674859a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.410154 Aug 17 20:25:03.044651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 250/497] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:02 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:04.075393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:04.077698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:04.082422 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=66 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:04.094778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:04.096950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:04.098247 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:04.099693 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:04.100696 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:04.101662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:04.356444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:04.369484 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:04.372616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:04.376394 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f8e23624-2e7a-42c2-8e06-1c9195f8632e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.310630 Aug 17 20:25:04.377741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 248/498] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:04 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:05.407015 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:05.407965 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:05.417415 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:05.418153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:05.419023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:05.419838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:05.420337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:05.420790 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:05.441566 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:05.509980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ed5bfae-e043-4ad5-b571-88ba090c722b", "device": "/dev/sdb"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:05.513259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:05.523746 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:05.526764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:05.526764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:05.527533 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:05.527533 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:05.528392 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:05.613984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:05.632773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:05.646779 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:05.648894 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cb16afdf-9658-46b2-b453-1e3b9b7a9fda tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.247369 Aug 17 20:25:05.649470 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 251/499] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:05 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:05.851470 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:05.867434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:05.875695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:05.884659 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:05.885152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:05.885595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:05.886329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:05.886838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:05.887442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:06.071558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lazy-loading 'services' on Instance uuid f848de82-5bd1-4bf9-b720-8a8fac4ea7cd {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:25:06.451065 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2e3574a2-d0f7-4022-b560-ca09c4099ad8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-volume_attachments/4320f67d-b1d0-49ba-9803-78e4ceca2a60" status: 202 len: 0 microversion: 2.1 time: 0.590528 Aug 17 20:25:06.452195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 252/500] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:25:05 2022] DELETE /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-volume_attachments/4320f67d-b1d0-49ba-9803-78e4ceca2a60 => generated 0 bytes in 593 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:25:06.680625 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:06.682707 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:06.696554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:06.697976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:06.700234 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:06.713409 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:06.716426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:06.717314 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:06.799136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4bbafde9-6c9a-4221-ad97-b00e2ddff56b tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "POST /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.293148 Aug 17 20:25:06.815795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 249/501] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:25:05 2022] POST /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3/os-volume_attachments => generated 194 bytes in 1311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:25:07.014198 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:07.024860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:07.027394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:07.027981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a44bb98b-1bcd-48e0-a82b-7a1dd836f142 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.356980 Aug 17 20:25:07.028565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 253/502] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:06 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:08.060145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:08.061738 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:08.075487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:08.076340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:08.076785 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:08.077516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:08.077976 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:08.078407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:08.277736 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:08.287874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:08.293193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:08.294116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-599f1bb7-4630-4a48-acd3-85eda306d731 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.243691 Aug 17 20:25:08.311051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 250/503] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:08 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:08.788845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2b12845f-c2a9-4135-b848-d8f63a1021c0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:08.795597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2b12845f-c2a9-4135-b848-d8f63a1021c0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:08.796081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2b12845f-c2a9-4135-b848-d8f63a1021c0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:08.796512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2b12845f-c2a9-4135-b848-d8f63a1021c0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:08.824432 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2b12845f-c2a9-4135-b848-d8f63a1021c0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Going to try to stop instance {{(pid=121275) force_stop /opt/stack/nova/nova/compute/api.py:2709}} Aug 17 20:25:09.323771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:09.324532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:09.331992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:09.332540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:09.332960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:09.333945 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:09.334402 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:09.334855 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:09.487916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:09.502311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:09.504046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:09.505545 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7ec70331-446d-4fab-8523-a7e5bb452266 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.186450 Aug 17 20:25:09.506074 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 251/504] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:09 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:09.587499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2b12845f-c2a9-4135-b848-d8f63a1021c0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action" status: 202 len: 0 microversion: 2.1 time: 0.804998 Aug 17 20:25:09.588699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 254/505] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:25:08 2022] POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action => generated 0 bytes in 807 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:25:09.607291 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:09.607291 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:09.626985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:09.627499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:09.627950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:09.628711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:09.629737 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:09.630202 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:09.830651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:09.851367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d809880b-b57f-4537-8622-aa7c242b35bc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.256072 Aug 17 20:25:09.852399 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 252/506] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:09 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:10.533447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:10.536831 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:10.547606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:10.548658 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:10.549113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:10.550033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:10.550498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:10.550996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:10.733742 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:10.743808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:10.745565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:10.747202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c44687d1-87ee-425b-826e-c4d75814ed98 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.220661 Aug 17 20:25:10.747941 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 255/507] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:10 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:10.876726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:10.877457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:10.886862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:10.887367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:10.887881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:10.888633 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:10.889117 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:10.889690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:11.039871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:11.047799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9c4b9a96-dde9-4de0-a0fe-8e8d573f501f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.175944 Aug 17 20:25:11.063237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 253/508] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:10 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:11.777362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:11.778616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:11.785525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:11.786269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:11.787441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:11.788230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:11.788626 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:11.789053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:11.955908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:11.965528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:11.970051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:11.971608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dc8e4ed4-0fc5-4fa0-aa3b-86aa95774b6e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.198181 Aug 17 20:25:11.987092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 256/509] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:11 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:12.071392 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:12.071994 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:12.079067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:12.079566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:12.080002 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:12.080728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:12.081182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:12.081609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:12.231390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:12.239473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9c0c7e1d-9594-473e-a5e7-288409c1360f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.172794 Aug 17 20:25:12.240600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 254/510] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:12 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:12.996795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:12.997368 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:13.003837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:13.004326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:13.004758 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:13.006478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:13.007213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:13.007640 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:13.161347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:13.170054 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:13.171597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:13.172825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1e7e7373-26ed-46bf-9778-0f6f539f6b21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.180199 Aug 17 20:25:13.173527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 257/511] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:12 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:13.262585 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:13.263208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:13.269938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:13.270441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:13.270953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:13.271718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:13.272174 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:13.272595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:13.437182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:13.447616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b31599e7-fb7e-4e1c-b0b4-423c1df1ebc7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.189068 Aug 17 20:25:13.448408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 255/512] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:13 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:14.199562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:14.200165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:14.208059 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:14.209162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:14.209606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:14.210522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:14.211016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:14.211452 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:14.359608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:14.372662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:14.374553 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:14.376100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-83be275f-a183-4565-a7cc-9b3b7ed7820a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1739 microversion: 2.20 time: 0.180452 Aug 17 20:25:14.376712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 258/513] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:14 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:14.470386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:14.471316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:14.479296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:14.479819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:14.480250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:14.481055 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:14.481674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:14.482096 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:14.635135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:14.643050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-35e2efc3-546f-46ea-b780-109423f90b00 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.177231 Aug 17 20:25:14.643639 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 256/514] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:14 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:15.418023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:15.418785 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:15.425751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:15.426241 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:15.426819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:15.427606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:15.428100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:15.428531 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:15.563893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:15.572459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:15.573986 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:15.575199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3a941c7f-4ce1-4604-990f-86123e098a21 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1721 microversion: 2.20 time: 0.161263 Aug 17 20:25:15.575759 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 259/515] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:15 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:15.665168 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:15.665861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:15.673280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:15.674433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:15.682559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:15.682559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:15.682559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:15.682559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:15.812750 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:15.821040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8845524c-756c-46a9-a84a-d7f51579d5b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.160248 Aug 17 20:25:15.821605 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 257/516] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:15 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:16.598391 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:16.599940 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:16.606728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:16.607222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:16.607668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:16.608394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:16.608851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:16.609277 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:16.768944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:16.778406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:16.780130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:16.781307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-eca0477e-30d7-4b94-b396-b5e5860e3649 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1721 microversion: 2.20 time: 0.186907 Aug 17 20:25:16.781864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 260/517] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:16 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1721 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:16.845287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:16.846017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:16.856622 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:16.857460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:16.858089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:16.859130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:16.859635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:16.860067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:17.024237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:17.034520 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-019fc75d-27fc-4ea3-8d98-bcd6ef33cad2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.195163 Aug 17 20:25:17.035135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 258/518] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:16 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:17.805799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:17.806426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:17.812935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:17.813430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:17.813853 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:17.814541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:17.815025 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:17.815450 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:17.951988 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:17.960809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:17.962489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:17.963694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a1bb602b-0eda-4b35-b985-b9b778d03b69 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1721 microversion: 2.20 time: 0.161873 Aug 17 20:25:17.964260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 261/519] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:17 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:18.057391 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:18.058091 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:18.064956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:18.065440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:18.065877 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:18.066574 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:18.067049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:18.067988 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:18.232673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:18.249681 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d107adc4-57d9-4abb-b75c-25abebea2dac tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.196088 Aug 17 20:25:18.250960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 259/520] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:18 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:18.987849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:18.988651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:18.995324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:18.995821 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:18.996264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:18.996972 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:18.997473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:18.997938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:19.132630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:19.141243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:19.142884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:19.144067 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e7516a19-4efd-4ea7-9d83-60cd1e8b5496 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1721 microversion: 2.20 time: 0.160340 Aug 17 20:25:19.144647 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 262/521] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:18 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:19.273072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:19.273691 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:19.280940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:19.281439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:19.281874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:19.282581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:19.283067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:19.283492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:19.435782 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:19.444831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6dff7157-c68d-4b70-a815-8e2a079dc956 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.175715 Aug 17 20:25:19.445419 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 260/522] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:19 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:20.167414 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:20.168401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:20.175315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:20.175799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:20.176235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:20.177051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:20.177803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:20.178373 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:20.316276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:20.325536 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:20.327083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:20.328252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-82de9dcc-e4c5-47e8-a222-7ebddb767bad tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1721 microversion: 2.20 time: 0.165140 Aug 17 20:25:20.328837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 263/523] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:20 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:20.465647 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:20.466177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:20.472939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:20.473422 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:20.473859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:20.475013 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:20.475498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:20.475980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:20.625396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:20.634285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-76e6d6e5-b024-49a7-a7ff-f9bb78ce1ae6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.172563 Aug 17 20:25:20.634897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 261/524] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:20 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:21.352856 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:21.353468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:21.360049 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:21.360537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:21.361000 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:21.361675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:21.362131 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:21.362558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:21.509408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:21.518091 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:21.519952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:21.521380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e9b7c886-d3b2-469e-be1f-a080e822895a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1721 microversion: 2.20 time: 0.172597 Aug 17 20:25:21.521946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 264/525] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:21 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1721 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:21.636759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-bf985781-90ab-4d52-a559-976d57309371 req-340f3896-686d-49bb-b86a-d025c6dd5186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43150116-1ad7-4a0c-b292-98ee4307770d", "name": "network-vif-unplugged", "status": "completed", "tag": "450fc8d5-29fd-4e49-8e9e-caca2f42f264"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:21.650068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-bf985781-90ab-4d52-a559-976d57309371 req-340f3896-686d-49bb-b86a-d025c6dd5186 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:21.650068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-bf985781-90ab-4d52-a559-976d57309371 req-340f3896-686d-49bb-b86a-d025c6dd5186 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:21.661087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:21.662406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:21.664384 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-bf985781-90ab-4d52-a559-976d57309371 req-340f3896-686d-49bb-b86a-d025c6dd5186 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:21.668960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:21.669445 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:21.670439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:21.671439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:21.671908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:21.672335 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:21.678593 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-bf985781-90ab-4d52-a559-976d57309371 req-340f3896-686d-49bb-b86a-d025c6dd5186 service nova] Creating event network-vif-unplugged:450fc8d5-29fd-4e49-8e9e-caca2f42f264 for instance 43150116-1ad7-4a0c-b292-98ee4307770d on hv-cinder-83538 Aug 17 20:25:21.685529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-bf985781-90ab-4d52-a559-976d57309371 req-340f3896-686d-49bb-b86a-d025c6dd5186 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052409 Aug 17 20:25:21.686907 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 262/526] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:25:21 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:25:21.832709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:21.841390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7abea311-7fab-49d5-8cab-f291f142074e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1677 microversion: 2.1 time: 0.190147 Aug 17 20:25:21.841981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 265/527] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:21 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1677 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:22.546171 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:22.546820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:22.553216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:22.553704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:22.554140 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:22.554869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:22.555354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:22.555791 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:22.699815 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:22.707807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:22.709701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:22.710880 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ef2e6715-25ff-4789-a172-3e5ec5058aa2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1724 microversion: 2.20 time: 0.169331 Aug 17 20:25:22.714983 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 263/528] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:22 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:22.733564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c0f7dc0-9243-477e-831a-e2de63f7d593"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:22.736113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:22.743601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:22.744033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:22.744467 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:22.745201 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:22.745665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:22.746094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:22.761896 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:22.862396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:22.863043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:22.870358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:22.870879 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:22.871319 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:22.872026 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:22.872487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:22.872911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:23.016066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:23.023805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1ffdfd8c-6656-4470-916f-b145e8da89d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1654 microversion: 2.1 time: 0.165459 Aug 17 20:25:23.024515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 264/529] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:22 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1654 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:23.044752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5a973f7a-87eb-4fb3-a89e-c8bbfd63fa0e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:23.050988 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a973f7a-87eb-4fb3-a89e-c8bbfd63fa0e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:23.051427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a973f7a-87eb-4fb3-a89e-c8bbfd63fa0e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:23.052458 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5a973f7a-87eb-4fb3-a89e-c8bbfd63fa0e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:23.075640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5a973f7a-87eb-4fb3-a89e-c8bbfd63fa0e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Going to try to start instance {{(pid=121276) start /opt/stack/nova/nova/compute/api.py:2732}} Aug 17 20:25:23.091026 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:23.235388 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5a973f7a-87eb-4fb3-a89e-c8bbfd63fa0e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action" status: 202 len: 0 microversion: 2.1 time: 0.194327 Aug 17 20:25:23.237270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 265/530] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:25:23 2022] POST /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/action => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:25:23.245969 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:23.246694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:23.253262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:23.253748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:23.254187 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:23.254925 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:23.255376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:23.255967 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:23.400718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:23.409450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-616639c8-aaec-4b7c-ad54-b782278a9145 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1663 microversion: 2.1 time: 0.168033 Aug 17 20:25:23.410040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 266/531] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:23 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1663 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:23.746616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b31758fb-d50e-4006-a42f-4b2e9a7d1f75 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.016929 Aug 17 20:25:23.747318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 266/532] 10.222.0.64 () {62 vars in 1364 bytes} [Wed Aug 17 20:25:22 2022] POST /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments => generated 188 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:25:23.874241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:23.874910 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:23.882178 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:23.882604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:23.883073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:23.883771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:23.884232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:23.884656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:23.927640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121276) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 20:25:24.240199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ec7096c2-ac92-49ac-bc58-d3aa60021bf1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/action" status: 202 len: 0 microversion: 2.20 time: 0.369195 Aug 17 20:25:24.240780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 267/533] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 17 20:25:23 2022] POST /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:25:24.249079 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:24.249686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:24.252567 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=46 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:24.258348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:24.258898 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:24.259333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:24.260029 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:24.260490 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:24.260910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:24.398992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:24.407511 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:24.409039 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:24.410197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0356d626-c6a8-4294-81ed-d861ec979401 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1750 microversion: 2.20 time: 0.165203 Aug 17 20:25:24.410773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 267/534] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:24 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:24.431922 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:24.432536 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:24.438568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:24.439086 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:24.439523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:24.440241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:24.440699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:24.441115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:24.584735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:24.593076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9de3b3b4-81e8-43bf-915e-8c6fa7cbbba7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1663 microversion: 2.1 time: 0.164878 Aug 17 20:25:24.593654 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 268/535] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:24 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1663 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:25.433876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:25.434490 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:25.441266 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:25.441815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:25.442732 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:25.443683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:25.444195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:25.444615 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:25.581292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:25.591700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:25.593253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:25.594460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-66645a45-8a6f-485e-b53d-d825db286f26 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1750 microversion: 2.20 time: 0.164762 Aug 17 20:25:25.595053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 268/536] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:25 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1750 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:25.615845 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:25.617040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:25.622774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:25.623334 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:25.623880 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:25.624591 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:25.625054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:25.625481 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:25.764032 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:25.773115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1ff2f135-dcde-4af3-8ecd-1ab45d1ba97a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1663 microversion: 2.1 time: 0.161716 Aug 17 20:25:25.773687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 269/537] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:25 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:26.618181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:26.618934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:26.625463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:26.626208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:26.626664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:26.627371 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:26.627842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:26.628258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:26.759304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:26.767643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:26.769131 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:26.770935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1ac6e85d-a8e1-4d28-baee-51e283f66867 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1752 microversion: 2.20 time: 0.156650 Aug 17 20:25:26.770935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 269/538] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:26 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1752 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:26.795495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:26.796482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:26.803303 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:26.803794 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:26.804234 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:26.804948 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:26.805408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:26.805840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:26.963281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:26.971275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3d71c5be-b119-4ceb-8135-aa7c71c4279b tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1663 microversion: 2.1 time: 0.179650 Aug 17 20:25:26.971865 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 270/539] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:26 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1663 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:27.793422 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:27.793936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:27.800515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:27.800999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:27.801449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:27.802181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:27.802701 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:27.803126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:27.946210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:27.955000 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:27.956552 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:27.957739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6d1d57a6-904c-4b20-a16c-568391045214 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1752 microversion: 2.20 time: 0.168352 Aug 17 20:25:27.958546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 270/540] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:27 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1752 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:27.998720 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:27.999355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:28.007121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:28.007608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:28.009623 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:28.009623 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:28.009623 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:28.009623 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:28.158329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:28.171651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b813ee78-f5f3-4088-babf-c19373205717 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1663 microversion: 2.1 time: 0.176591 Aug 17 20:25:28.172716 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 271/541] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:27 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1663 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:28.981721 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:28.982267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:28.994348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:28.994348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:28.994348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:28.994348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:28.994813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:28.994813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:29.130307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:29.139110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:29.140593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:29.141743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c10ce0f8-f36c-4c67-ae24-a999d4d1d513 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1752 microversion: 2.20 time: 0.164029 Aug 17 20:25:29.142303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 271/542] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:28 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1752 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:29.194529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:29.195215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:29.201935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:29.202435 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:29.202906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:29.203602 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:29.204056 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:29.204478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:29.336459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:29.344076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fb173d9d-e7f3-4ab1-ae95-6190923cdfa8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1667 microversion: 2.1 time: 0.153402 Aug 17 20:25:29.344647 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 272/543] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:29 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1667 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:30.164595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:30.165225 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:30.171767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:30.172254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:30.172692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:30.173393 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:30.173852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:30.174279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:30.309739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:30.319111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:30.320609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:30.321791 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-842ceefb-b44f-44a7-b445-1d313d1d0812 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1752 microversion: 2.20 time: 0.161352 Aug 17 20:25:30.322348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 272/544] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:30 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:31.345116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:31.345733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:31.352929 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:31.353467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:31.353904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:31.354868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:31.355333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:31.355763 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:31.505824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:31.514418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:31.516007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:31.517180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-42a07b59-2910-4b44-9604-091b67727e41 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.176153 Aug 17 20:25:31.517745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 273/545] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:31 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:32.541051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:32.541940 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:32.548572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:32.560203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:32.560203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:32.560203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:32.560203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:32.561160 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:32.689332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:32.698079 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:32.699606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:32.700768 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-235b3c0b-0bfb-4967-9340-2d3ba889fddd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.163629 Aug 17 20:25:32.701316 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 273/546] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:32 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:33.726037 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:33.727509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:33.734932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:33.735713 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:33.736332 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:33.737502 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:33.738140 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:33.738569 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:33.910618 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:33.921152 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:33.922733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:33.923992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6f239a91-a084-43be-80a0-1f43e6f1ce27 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.202661 Aug 17 20:25:33.924803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 274/547] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:33 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:34.949766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:34.951184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:34.958553 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:34.959078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:34.959521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:34.960237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:34.960696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:34.961122 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:35.105388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:35.115271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:35.116784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:35.117973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7773ffbd-d7ff-4935-911b-b3744c06a5ea tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.172347 Aug 17 20:25:35.118536 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 274/548] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:34 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:35.176217 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:35.177657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:35.180585 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:35.185974 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:35.186494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:35.186966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:35.187700 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:35.188151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:35.188576 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:35.351432 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lazy-loading 'services' on Instance uuid 618e1ab8-0237-465a-820f-b0886789b9d3 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:25:35.679594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dc18ee63-c34a-44ec-bd88-f49794a35cd0 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "DELETE /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3/os-volume_attachments/8ed5bfae-e043-4ad5-b571-88ba090c722b" status: 202 len: 0 microversion: 2.1 time: 0.507358 Aug 17 20:25:35.680193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 275/549] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:25:35 2022] DELETE /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3/os-volume_attachments/8ed5bfae-e043-4ad5-b571-88ba090c722b => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:25:36.142092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:36.142743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:36.149512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:36.153904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:36.153904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:36.162472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:36.162472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:36.163184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:36.315570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:36.327094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:36.328727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:36.330013 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-50884eb9-9939-456d-b654-917528ee65b1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.191857 Aug 17 20:25:36.330580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 275/550] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:36 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:37.357092 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:37.357794 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:37.364131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:37.364686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:37.365250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:37.365956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:37.366408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:37.366876 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:37.521038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:37.530772 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:37.532368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:37.533808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b5d97a62-7a13-4b71-bb00-90a3fe39be01 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.181611 Aug 17 20:25:37.534381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 276/551] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:37 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:38.573767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:38.574532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:38.581691 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:38.582199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:38.583249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:38.583976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:38.584539 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:38.584971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:38.747272 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:38.756723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:38.758244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:38.759477 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8948a9ca-1675-4752-9be9-10ba1db6ffcb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.191415 Aug 17 20:25:38.760050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 276/552] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:38 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:39.784640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:39.785281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:39.792272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:39.792856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:39.793517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:39.794218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:39.794684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:39.795105 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:39.946867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:39.962036 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:39.964761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:39.966824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e557009c-4d62-45d1-99bd-407e03d9e624 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.186015 Aug 17 20:25:39.967777 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 277/553] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:39 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:40.668703 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "36b934c0-b3fc-4cb5-b1e0-e4eb0744eb96"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:40.675429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:40.679150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:40.679702 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:40.680111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:40.680866 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:40.681218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:40.681637 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:40.993022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:40.993673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:41.000793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:41.001283 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:41.001723 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:41.002586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:41.002906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:41.003333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:41.167630 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:41.181762 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:41.181762 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:41.182098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b973fd27-b699-4fcc-9c7a-445fb966af0d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.193474 Aug 17 20:25:41.182743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 278/554] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:40 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:42.206317 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:42.207149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:42.214266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:42.214863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:42.215303 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:42.216036 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:42.216493 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:42.216914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:42.364390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:42.374342 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:42.376155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:42.377399 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-510a3799-f631-49eb-a5cc-72f8610877bc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.175773 Aug 17 20:25:42.380027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 279/555] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:42 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:43.402594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:43.403313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:43.409529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:43.410004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:43.410464 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:43.411528 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:43.411985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:43.412407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:43.415054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:43.594237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:43.603916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:43.605400 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:43.606597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-454484d8-3c1b-49bb-b642-25a0a54838f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.207985 Aug 17 20:25:43.607204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 280/556] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:43 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:44.630704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:44.631504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:44.638269 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:44.638791 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:44.639223 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:44.639921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:44.640378 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:44.640803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:44.796819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:44.806767 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:44.808355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:44.809494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0cc323e0-0fe1-4ddd-8293-e0d85df21820 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.182778 Aug 17 20:25:44.810062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 281/557] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:44 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:45.099499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-affd68b0-a327-46bf-9804-17c55bb276bc tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.434714 Aug 17 20:25:45.105689 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 277/558] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:25:40 2022] POST /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 194 bytes in 4442 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:25:45.514674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:45.517240 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:45.523950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:45.524447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:45.524890 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:45.525600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:45.526149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:45.526684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:45.807899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-17155caa-9074-4f7c-9008-3f0a47705bc5 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/action" status: 202 len: 0 microversion: 2.1 time: 0.297347 Aug 17 20:25:45.808528 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 282/559] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:25:45 2022] POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/action => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:25:45.818849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:45.819526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:45.826756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:45.827528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:45.827975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:45.829133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:45.829604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:45.830035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:45.835483 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:45.835714 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:45.842392 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:45.843042 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:45.843660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:45.844389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:45.844846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:45.845444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:46.063846 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:46.067787 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:46.072614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1aef99c9-d907-4460-bfa1-f8e84c0ec303 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1754 microversion: 2.1 time: 0.259285 Aug 17 20:25:46.073216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 278/560] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:45 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1754 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:46.076869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:46.078409 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:46.079641 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-da6e14b3-b918-483f-a615-18a4d3a46c07 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.249779 Aug 17 20:25:46.080248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 283/561] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:45 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:46.446879 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:46.447527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:46.454425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:46.454851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:46.455293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:46.455997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:46.456485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:46.456905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:46.462128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=4,nova_cell1:UPDATE=6 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:46.484090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:25:46.826744 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d9dc7d1e-ef4b-4374-bba7-13e9a1464669 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "DELETE /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 204 len: 0 microversion: 2.1 time: 0.383446 Aug 17 20:25:46.827249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 279/562] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:25:46 2022] DELETE /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:25:46.836508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:46.837128 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:46.843690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:46.844176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:46.844621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:46.845368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:46.846537 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:46.846537 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:46.989719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:46.997840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c39624c0-5353-4d03-8f41-b4f0daa2b9ae tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1513 microversion: 2.1 time: 0.165879 Aug 17 20:25:46.998429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 284/563] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:46 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:47.097328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:47.098589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:47.104190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:47.104800 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:47.105080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:47.105576 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:47.106017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:47.106751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:47.107211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:47.107646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:47.111186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:47.111708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:47.112139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:47.112843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:47.113311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:47.114322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:47.574829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:47.580266 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:47.584339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:47.585849 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:47.587035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-aa7c25a6-724e-4f33-9fe6-e3d002f435b0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.486763 Aug 17 20:25:47.587587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 285/564] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:47 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:47.589118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7c7a207d-2211-4f4d-84cb-c44f19e6890f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1754 microversion: 2.1 time: 0.496079 Aug 17 20:25:47.589677 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 280/565] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:47 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1754 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:48.023249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:48.023866 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:48.030318 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:48.030851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:48.031293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:48.032190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:48.032507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:48.032937 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:48.167827 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:48.175761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3cadf8ea-ce46-451b-bec6-3801168bf96c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1513 microversion: 2.1 time: 0.157194 Aug 17 20:25:48.176883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 286/566] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:48 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1513 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:48.611350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:48.611738 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:48.612217 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:48.612422 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:48.619532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:48.624784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:48.624784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:48.624784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:48.624784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:48.625158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:48.625488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:48.625488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:48.625488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:48.625488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:48.626200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:48.626935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:48.879720 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:48.887640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:48.889189 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:48.890604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ca010737-39ff-47bb-9a76-a22292ecefaa tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.283334 Aug 17 20:25:48.891237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 287/567] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:48 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:48.900597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:48.914880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-412c0e42-5f71-4ca3-aff3-862d244110a0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1754 microversion: 2.1 time: 0.307414 Aug 17 20:25:48.915568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 281/568] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:48 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1754 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:49.198157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:49.199094 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:49.205643 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:49.206137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:49.206576 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:49.207509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:49.208078 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:49.208508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:49.361684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:49.371119 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-76fe0a09-2801-455a-ae7f-55dcabfc18a6 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1513 microversion: 2.1 time: 0.176740 Aug 17 20:25:49.371680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 288/569] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:49 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1513 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:49.914227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:49.914873 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:49.921631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:49.922120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:49.922554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:49.923284 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:49.923740 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:49.924160 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:49.936846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:49.937376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:49.944130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:49.944619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:49.945127 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:49.945811 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:49.946264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:49.946706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:50.123160 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:50.132979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:50.134468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:50.135657 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-021c96f4-31ec-4033-a425-1d0ad48a087c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.225438 Aug 17 20:25:50.136210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 282/570] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:49 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:50.150856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:50.158934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-041e8d90-010b-4cb9-916f-e9817ddb13b9 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.225988 Aug 17 20:25:50.159501 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 289/571] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:49 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:50.403111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:50.403726 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:50.410082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:50.410889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:50.411328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:50.412021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:50.412477 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:50.412921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:50.544213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:50.552430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-33860825-00ae-4b4e-adce-3c9174f8614c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1513 microversion: 2.1 time: 0.153155 Aug 17 20:25:50.553006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 283/572] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:50 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:51.156784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-4cbc4051-c1c9-4499-ad37-7fbeb26d67bb req-607a7600-9a14-485a-9aa5-2ba533637739 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "618e1ab8-0237-465a-820f-b0886789b9d3", "name": "network-vif-deleted", "tag": "2f52609a-2602-478e-82f6-9857e1154033"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:51.158999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:51.159604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:51.167075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.171883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.171883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.172154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-4cbc4051-c1c9-4499-ad37-7fbeb26d67bb req-607a7600-9a14-485a-9aa5-2ba533637739 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.172154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-4cbc4051-c1c9-4499-ad37-7fbeb26d67bb req-607a7600-9a14-485a-9aa5-2ba533637739 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.172318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.172395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-4cbc4051-c1c9-4499-ad37-7fbeb26d67bb req-607a7600-9a14-485a-9aa5-2ba533637739 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.172479 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.172479 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.181837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-4cbc4051-c1c9-4499-ad37-7fbeb26d67bb req-607a7600-9a14-485a-9aa5-2ba533637739 service nova] Creating event network-vif-deleted:2f52609a-2602-478e-82f6-9857e1154033 for instance 618e1ab8-0237-465a-820f-b0886789b9d3 on hv-cinder-83538 Aug 17 20:25:51.187150 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-4cbc4051-c1c9-4499-ad37-7fbeb26d67bb req-607a7600-9a14-485a-9aa5-2ba533637739 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034604 Aug 17 20:25:51.188020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 290/573] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:25:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:25:51.193222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:51.194581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:51.201127 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.201648 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.202084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.202813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.203266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.203690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.383147 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:51.392255 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:51.395257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:51.396298 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9ddca28f-041e-4b62-a3a4-dafd4cc86b10 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.241060 Aug 17 20:25:51.396866 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 284/574] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:51 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:51.405121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:51.414919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3785333b-67ac-4707-86dd-d9c585d2d733 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.225677 Aug 17 20:25:51.415835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 291/575] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:51 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:51.574724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:51.575245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:51.581518 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.582213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.583307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.584140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.584602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.585031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.616239 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:51.616718 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:51.617153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:51.617604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lazy-loading 'fault' on Instance uuid 618e1ab8-0237-465a-820f-b0886789b9d3 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:25:51.661125 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:51.668844 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-771318dc-848c-4ef5-bb91-0178173d3ccd tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 200 len: 1309 microversion: 2.1 time: 0.098096 Aug 17 20:25:51.671735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 285/576] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:51 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 1309 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:52.419639 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:52.420239 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:52.427412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:52.427892 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:52.428327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:52.429014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:52.429471 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:52.429958 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:52.435994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:52.436598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:52.444161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:52.444437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:52.444872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:52.446327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:52.446327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:52.446543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:52.642452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:52.651142 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:52.652826 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:52.654073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-627ecbfa-4d0d-4ca6-be2c-72b3f48c7c08 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.238395 Aug 17 20:25:52.654655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 292/577] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:52 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:52.669377 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:52.680223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3aa44570-b91f-4a06-975b-fbbf9a3c140d tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.247879 Aug 17 20:25:52.680812 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 286/578] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:52 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:52.690814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:52.691500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 618e1ab8-0237-465a-820f-b0886789b9d3] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:52.697721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:52.698175 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:52.698571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:52.699276 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:52.699744 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:52.700147 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:52.713845 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] HTTP exception thrown: Instance 618e1ab8-0237-465a-820f-b0886789b9d3 could not be found. Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Request method failure captured: Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 HTTP/1.1 Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U5bekyKvbqpyrx_ozXYKuUR2PknKwtMH9k_0FVsjy_5ayQQjDC_Re0exODtEEut6EKgIgGdOEbFmWanekvHF9fisktndgmeSgDZTMfquKoIJ8VEjbAX-fDwvssJMNjV0VzpUJa4fkMhlalrzYDPiXoYkQ4YRXPHAADBM7QYDnBessw Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 11fb3890c76b4b60bac49fdcb8dbb71e Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2111127848 Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:25:52.715547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesSnapshotTestJSON-2111127848 Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 11fb3890c76b4b60bac49fdcb8dbb71e Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2111127848 Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesSnapshotTestJSON-2111127848-project Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 4e62a4adc12f4963b09b495122c0a6d5 Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesSnapshotTestJSON-2111127848-project Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 618e1ab8-0237-465a-820f-b0886789b9d3 could not be found. Aug 17 20:25:52.717151 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '618e1ab8-0237-465a-820f-b0886789b9d3'} Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 618e1ab8-0237-465a-820f-b0886789b9d3 could not be found. Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:25:52.718038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 618e1ab8-0237-465a-820f-b0886789b9d3 could not be found. Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 618e1ab8-0237-465a-820f-b0886789b9d3 could not be found. Aug 17 20:25:52.719512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:25:52.720806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Returning 404 to user: Instance 618e1ab8-0237-465a-820f-b0886789b9d3 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:25:52.720806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ccca7768-7bff-4e6a-8b27-4c79bfe9955c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3" status: 404 len: 111 microversion: 2.1 time: 0.030128 Aug 17 20:25:52.720806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 293/579] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:52 2022] GET /compute/v2.1/servers/618e1ab8-0237-465a-820f-b0886789b9d3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:25:53.678306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:53.678945 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:53.686032 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:53.686527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:53.686992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:53.687689 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:53.688596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:53.688596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:53.704431 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:53.705210 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:53.712280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:53.713009 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:53.713230 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:53.713839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:53.714295 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:53.714819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:53.905417 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:53.915261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:53.916770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:53.917953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-eb8b3250-458e-4bbd-b65a-a0e183622636 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.244457 Aug 17 20:25:53.918525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 287/580] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:53 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:53.928667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:53.936981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a0e89af3-5182-4a4d-88d2-152b56a593ea tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.236485 Aug 17 20:25:53.937580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 294/581] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:53 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:54.943076 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:54.943738 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:54.946788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:54.952640 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:54.953213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:54.953743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:54.954590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:54.955150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:54.955651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:54.960270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:54.960903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:54.967631 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:54.968107 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:54.968531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:54.969233 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:54.969663 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:54.970088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:55.183758 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:55.189147 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:55.193571 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:55.195218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:55.196512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0657b72e-8089-40b8-9767-2d181885f78c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.258084 Aug 17 20:25:55.197242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 288/582] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:54 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:55.197731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-24ddd478-ad74-4c45-ab4d-7efe8f9f120e tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.243579 Aug 17 20:25:55.198302 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 295/583] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:54 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:56.219515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:56.220126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:56.221041 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:56.221641 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:56.226972 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:56.227475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:56.227916 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:56.228621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:56.228743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:56.229074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:56.229190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:56.229500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:56.229604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:56.230187 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:56.230779 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:56.231069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:56.452999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:56.459152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:56.462280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:56.463927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:56.465110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bbb43103-3757-4128-bb3d-1454d1799e86 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.247916 Aug 17 20:25:56.465670 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 296/584] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:56 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:25:56.467392 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3ec742ea-ae99-47fd-859f-c0c81d9a4bf4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.251708 Aug 17 20:25:56.467946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 289/585] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:56 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:57.489331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:57.490329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:57.490982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:57.491156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:57.497464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:57.497771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:57.498301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:57.498429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:57.498519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:57.498745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:57.499263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:57.499439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:57.499724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:57.499835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:57.500410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:57.500747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:57.505164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:57.723557 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:57.730269 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:57.737212 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1861191a-3f25-402d-8c78-f917f70e9c68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.251050 Aug 17 20:25:57.737837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 290/586] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:57 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:57.749626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:57.749626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:57.749626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4b0f6a01-64d1-417a-8d2b-d2aee247a42f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.262651 Aug 17 20:25:57.749959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 297/587] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:57 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:57.992385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:57.994665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:58.001531 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.002050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.002494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.003277 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.003740 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.004203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.027761 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'flavor' on Instance uuid 19fb5faa-99aa-4e6a-9d28-c82d7c47222d {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:25:58.282162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:25:58.380092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-650d1c6e-dd9f-44a4-b861-c4a29f32839f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/action" status: 200 len: 32 microversion: 2.1 time: 0.391743 Aug 17 20:25:58.380899 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 291/588] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:25:57 2022] POST /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/action => generated 32 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:25:58.390373 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:58.391027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:58.399335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.400542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.401032 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.401748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.402203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.402622 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.561835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:58.573300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1386d03e-ece7-4495-9ede-e4bd55569432 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.186617 Aug 17 20:25:58.574513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 298/589] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:58 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:25:58.743103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-891186ce-aee9-4d44-955e-e64f817b2e38 req-2f9c0e64-2ea8-4996-83e1-b67924fc0506 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43150116-1ad7-4a0c-b292-98ee4307770d", "name": "network-vif-plugged", "status": "completed", "tag": "450fc8d5-29fd-4e49-8e9e-caca2f42f264"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:25:58.756205 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-891186ce-aee9-4d44-955e-e64f817b2e38 req-2f9c0e64-2ea8-4996-83e1-b67924fc0506 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.756696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-891186ce-aee9-4d44-955e-e64f817b2e38 req-2f9c0e64-2ea8-4996-83e1-b67924fc0506 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.759667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-891186ce-aee9-4d44-955e-e64f817b2e38 req-2f9c0e64-2ea8-4996-83e1-b67924fc0506 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.761262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:58.761893 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:58.768800 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.769339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.770364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.771259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.771628 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.772110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-891186ce-aee9-4d44-955e-e64f817b2e38 req-2f9c0e64-2ea8-4996-83e1-b67924fc0506 service nova] Creating event network-vif-plugged:450fc8d5-29fd-4e49-8e9e-caca2f42f264 for instance 43150116-1ad7-4a0c-b292-98ee4307770d on hv-cinder-83538 Aug 17 20:25:58.772327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.777656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-891186ce-aee9-4d44-955e-e64f817b2e38 req-2f9c0e64-2ea8-4996-83e1-b67924fc0506 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040058 Aug 17 20:25:58.778970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 292/590] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:25:58.786592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:58.787350 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:58.795310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.796792 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.796792 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:58.797074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:58.797488 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:58.797927 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:59.026004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:59.034324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bc317e62-b84f-4c37-ace5-461396374daa tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.277608 Aug 17 20:25:59.035994 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 299/591] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:58 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:25:59.042365 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:59.051398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:59.052983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:59.054149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-89a0efb8-3644-43f4-ad59-7e52d157105d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.273702 Aug 17 20:25:59.054736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 293/592] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:25:58 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:25:59.596543 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:25:59.597176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:25:59.604321 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:59.604804 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:59.605232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:59.605932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:25:59.606379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:25:59.606848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:25:59.749548 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:25:59.759593 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9091c293-ccb5-46aa-98c8-c06fb9fec190 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.167129 Aug 17 20:25:59.760175 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 300/593] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:25:59 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:00.057271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:00.058504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:00.064772 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.065270 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.065713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.067027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.067504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.067964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.078190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:00.078843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:00.086412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.086961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.087396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.088128 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.088591 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.089017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.297185 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:00.306488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:00.307532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:00.308032 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:00.309219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8bfbfe76-cde8-485e-af89-15c87bd6972f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.234927 Aug 17 20:26:00.309965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 301/594] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:26:00 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:26:00.317622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1d31c591-aa3e-4894-9dea-837be8c5438f tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.263337 Aug 17 20:26:00.318276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 294/595] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:00 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:00.781657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:00.782313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:00.790349 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.790928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.791371 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.792088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:00.792547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:00.792974 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:00.930598 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:00.939053 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-87746bca-c8fd-40c7-a4da-b5185046afff tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.161269 Aug 17 20:26:00.939635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 302/596] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:00 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:01.334843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:01.335817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:01.342878 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:01.343526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.343979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:01.344154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.344488 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:01.345251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.345710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.346138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:01.352416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.352903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.353337 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:01.354041 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.354600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.355054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:01.601613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:01.607552 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:01.610771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:01.612302 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:01.613765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ad5d1b76-345e-4c81-99db-53d523d5b1d3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.284269 Aug 17 20:26:01.614984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 295/597] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:26:01 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:26:01.616420 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4091f0ab-e5d9-4d5e-8cc8-08065c97c832 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.280520 Aug 17 20:26:01.617261 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 303/598] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:01 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:01.961612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:01.962233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:01.968584 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.969077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.969520 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:01.970218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:01.970699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:01.971129 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:02.124845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:02.134756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d87c1d56-04e9-4127-aab1-86c5ed77b273 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.177635 Aug 17 20:26:02.135397 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 296/599] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:01 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:02.639864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:02.640977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:02.643867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:02.646023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:02.648954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:02.649523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:02.649966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:02.650715 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:02.651177 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:02.651764 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:02.659121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:02.661710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:02.661710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:02.662743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:02.663527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:02.664315 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:02.910751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:02.915156 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:02.923507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f0ae3328-a4bc-4462-9e25-d8e714f33cd8 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.287957 Aug 17 20:26:02.924197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 297/600] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:02 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:02.926784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:02.930799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:02.934056 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-16126612-78c2-46ee-ad0e-063bd1284cf4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.297858 Aug 17 20:26:02.935650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 304/601] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:26:02 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:26:03.157631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:03.158216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:03.166168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.166168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.166558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.167360 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.167772 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.168200 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.328462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:03.340911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a88b8326-73af-448b-bb0b-c955c645857c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.187649 Aug 17 20:26:03.341573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 298/602] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:03 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:03.393715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1424564996", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "networks": [{"uuid": "37d2423c-b603-45a9-b465-f76696c65e59"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:03.452831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] validate_networks() for [('37d2423c-b603-45a9-b465-f76696c65e59', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:26:03.897911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:26:03.899300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:26:03.899300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:26:03.899966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:26:03.900646 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:26:03.913864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.914827 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.915939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.916776 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.917419 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.918165 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.947666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Getting quotas for project 11fb3890c76b4b60bac49fdcb8dbb71e. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:26:03.950126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:03.952577 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:03.959081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Getting quotas for user 4e62a4adc12f4963b09b495122c0a6d5 and project 11fb3890c76b4b60bac49fdcb8dbb71e. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:26:03.962051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.962983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.963463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.964412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:03.964982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:03.965470 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:03.973291 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:26:03.975669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:26:04.147607 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:04.161005 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1ba907f7-0925-4dcb-a340-2e5e1f02fbec tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.216721 Aug 17 20:26:04.161960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 299/603] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:03 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:04.170435 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:04.171458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:04.180987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:04.181575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:04.181975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:04.182811 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:04.183279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:04.183709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:04.208333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-562383d8-6aac-4b01-9611-18191eb4296e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.818366 Aug 17 20:26:04.209020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 305/604] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:26:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 820 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:26:04.250343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0757dc8a-b02a-4f85-8359-7cf3dfab2439 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:04.251276 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0757dc8a-b02a-4f85-8359-7cf3dfab2439 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:04.350383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0757dc8a-b02a-4f85-8359-7cf3dfab2439 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:04.372367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0757dc8a-b02a-4f85-8359-7cf3dfab2439 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1219 microversion: 2.1 time: 0.147556 Aug 17 20:26:04.387203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 306/605] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:04 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1219 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:04.403796 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:04.404885 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:04.413482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:04.415416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:04.415416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:04.416310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:04.417111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:04.417993 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:04.443704 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:04.453264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:04.454773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:04.456227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4e583041-5dbd-43c9-8f94-66315247f4dd tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.292725 Aug 17 20:26:04.457112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 300/606] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:26:04 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:26:04.592100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:04.602926 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f19c4cdf-d7c2-4403-a7fa-e50ea8580d13 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.214174 Aug 17 20:26:04.603831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 307/607] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:04 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:05.190581 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:05.192204 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:05.205665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.206617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.207401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.208227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.208781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.209260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.383248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:05.392572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a0ef5dab-9ec6-41e5-888f-97405f9a649c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.209877 Aug 17 20:26:05.402100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 301/608] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:05 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:05.409266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:05.410673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:05.418108 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.418606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.419089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.419856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.420327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.420968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.491106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:05.491779 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:05.497792 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.498561 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.499158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.499877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.500701 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.501130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.503881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:05.513000 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-62363b5b-1eec-4ba3-b7ea-4ca97a14867f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1223 microversion: 2.1 time: 0.107787 Aug 17 20:26:05.513803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 308/609] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:05 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:05.763496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:05.763496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:05.763496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:05.764107 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:05.764367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.764367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.764367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.764367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:05.764822 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:05.764822 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:05.765053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:05.765053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:05.765053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1e4685e0-f1f7-45d4-ab3e-fd64587988c5 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1808 microversion: 2.20 time: 0.171129 Aug 17 20:26:05.765528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 302/610] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:26:05 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:26:05.815316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:05.824942 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a5b939b9-3c89-4616-8869-a3266eb0f513 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.188902 Aug 17 20:26:05.840389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 309/611] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:05 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:06.415050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:06.415607 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:06.422315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.422845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.423292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:06.424015 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.424487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.424915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:06.548509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:06.549135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:06.557626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.558097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.558538 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:06.559281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.559746 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.560177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:06.596036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:06.606052 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-23c78f98-32de-4e33-b172-56656cd686d6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.195188 Aug 17 20:26:06.606858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 303/612] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:06 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:06.643986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:06.654157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-00a21c01-58d0-4cb3-bd9e-80994d152488 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1271 microversion: 2.1 time: 0.109907 Aug 17 20:26:06.654887 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 310/613] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:06 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1271 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:06.682172 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:06.682836 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:06.691350 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.691957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.692968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:06.693774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.694334 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.694920 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:06.838149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:06.847907 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:06.849406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:06.850602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cee403ad-a365-4522-b324-8ad659412507 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1795 microversion: 2.20 time: 0.172478 Aug 17 20:26:06.851195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 304/614] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:26:06 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1795 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:26:06.861954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:06.863302 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:06.871755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.872466 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.873204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:06.874319 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:06.875227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:06.875724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:07.045849 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:07.055848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3244b701-d2c4-4aeb-8702-022de35e1035 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.198566 Aug 17 20:26:07.056456 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 311/615] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:06 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:07.631914 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:07.632588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:07.639666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:07.639964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:07.640403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:07.641168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:07.641632 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:07.642059 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:07.677005 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:07.677706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:07.691875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:07.693248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:07.694118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:07.695460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:07.696418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:07.697265 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:07.823084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:07.838334 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-25d7dfe0-5cb3-4e15-bf56-5b2b95c5218c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1289 microversion: 2.1 time: 0.165567 Aug 17 20:26:07.860414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 312/616] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:07 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1289 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:07.919860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:07.933711 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d3263856-e29d-4180-98ba-14cb1144448b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.306548 Aug 17 20:26:07.934315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 305/617] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:07 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:08.078374 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:08.079082 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:08.087331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.087842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.088289 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.089030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.089504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.089933 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.289578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:08.309202 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ee9a6340-746e-4b85-a1e0-b5e82d22f6e6 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.234903 Aug 17 20:26:08.309866 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 313/618] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:08 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:08.872839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:08.873460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:08.881592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.882089 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.882529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.883271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.883734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.884161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.956897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:08.958137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:08.965076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.965575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.966015 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:08.967310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:08.967310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:08.967660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:09.069233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:09.085100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-41234f4b-7d25-45c7-943b-4cee45e6447a tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.216250 Aug 17 20:26:09.085982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 306/619] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:08 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:09.153414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:09.163301 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7a9a8e1b-dbbb-4387-8929-2462d860f91c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.210622 Aug 17 20:26:09.163900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 314/620] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:08 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:09.340019 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:09.340927 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:09.349455 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:09.350275 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:09.350941 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:09.351874 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:09.352492 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:09.353150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:09.443867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-240da3df-d97b-4659-9464-dd97f22d3e62 req-4710cf96-e357-4ca6-b007-98fb4d083df1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bab388e-43b0-426b-b624-dc5463b096df", "tag": "bb5ad8e5-1428-49b8-a99d-fd470742136f"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:09.459472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-240da3df-d97b-4659-9464-dd97f22d3e62 req-4710cf96-e357-4ca6-b007-98fb4d083df1 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:09.461651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-240da3df-d97b-4659-9464-dd97f22d3e62 req-4710cf96-e357-4ca6-b007-98fb4d083df1 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:09.461651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-240da3df-d97b-4659-9464-dd97f22d3e62 req-4710cf96-e357-4ca6-b007-98fb4d083df1 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:09.501854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-240da3df-d97b-4659-9464-dd97f22d3e62 req-4710cf96-e357-4ca6-b007-98fb4d083df1 service nova] Creating event network-changed:bb5ad8e5-1428-49b8-a99d-fd470742136f for instance 6bab388e-43b0-426b-b624-dc5463b096df on hv-cinder-83538 Aug 17 20:26:09.510832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-240da3df-d97b-4659-9464-dd97f22d3e62 req-4710cf96-e357-4ca6-b007-98fb4d083df1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071820 Aug 17 20:26:09.511841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 315/621] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:09.554788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:09.569291 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-71ec3a72-0900-4090-b0cc-ecc10329daef tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.233713 Aug 17 20:26:09.570095 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 307/622] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:09 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:10.118134 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:10.119579 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:10.131297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.132148 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.132903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.134138 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.134973 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.135730 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.144155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:10.190114 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:10.192676 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:10.202837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.203765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.204709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.205712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.206760 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.207049 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.327207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:10.342149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7ad5a4d4-0066-408b-8a3e-75ab8bcf6a07 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.233333 Aug 17 20:26:10.343209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 316/623] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:10 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:10.453844 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:10.462783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-46bfe7bf-46cf-4691-bb48-b35c4aaa4ee4 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.280525 Aug 17 20:26:10.463378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 308/624] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:10 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:10.595753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:10.596374 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:10.604196 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.604711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.605222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.605854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:10.606395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:10.606887 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:10.792201 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:10.802743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7a6f69c9-b308-4ab7-8f9d-280e8f8d4743 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.210810 Aug 17 20:26:10.805232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 317/625] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:10 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:11.363652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:11.364253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:11.371204 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.371687 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.372119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:11.372836 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.373312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.373725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:11.377037 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:11.485484 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:11.486107 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:11.497656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.498524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.499416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:11.503780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.503780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.503780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:11.539532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:11.548755 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-69a249c7-25ba-4ca3-b1e6-1fa6af9762f8 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.189035 Aug 17 20:26:11.549686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 309/626] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:11 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:11.774558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:11.783002 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f9847ff2-42f3-42ab-b757-e66a129dc919 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.301310 Aug 17 20:26:11.783760 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 318/627] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:11 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:11.827954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:11.828610 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:11.835747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.836222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.836656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:11.837356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:11.837798 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:11.838286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:11.984994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:11.993202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d4fa887d-d50e-4737-a3b8-6cdbbf8980d8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.169480 Aug 17 20:26:11.993785 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 310/628] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:11 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:12.573736 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:12.574316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:12.581660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:12.582177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:12.583235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:12.583968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:12.584426 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:12.584854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:12.735491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:12.745916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-61e8cce5-7b3a-4fce-b61b-7162eb0e0861 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.175911 Aug 17 20:26:12.746780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 319/629] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:12 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:12.806375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:12.807101 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:12.814589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:12.815112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:12.815551 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:12.816330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:12.816884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:12.817316 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:12.977592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:12.988267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ce5e8758-ad17-4b5c-9881-0490f1984a68 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1759 microversion: 2.1 time: 0.185707 Aug 17 20:26:12.989039 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 311/630] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:12 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1759 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:13.017448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:13.018114 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:13.025627 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:13.026116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:13.026559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:13.027309 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:13.027774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:13.028238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:13.200511 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:13.210558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9fbba1b1-b97a-4b77-9043-51fd0cda034c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.196794 Aug 17 20:26:13.211183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 320/631] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:13 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:13.770125 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:13.770693 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:13.779056 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:13.779685 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:13.780214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:13.780955 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:13.781412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:13.781861 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:14.011278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:14.011911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:14.014440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:14.018882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:14.021850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:14.022383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:14.023177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:14.024102 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:14.024682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:14.025354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:14.027673 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e15dabc7-f8f7-4bed-93a2-541bad5fb3de tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.263235 Aug 17 20:26:14.028258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 312/632] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:13 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:14.215745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:14.227806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f6299848-bd09-4b64-b910-c459f1344f2c tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1762 microversion: 2.1 time: 0.220528 Aug 17 20:26:14.228500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 321/633] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:14 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1762 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:14.234753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:14.236080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:14.247741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:14.248660 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:14.249430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:14.250989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:14.251829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:14.252597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:14.428573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:14.440612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2a988892-6f1f-43e1-a4af-ec6f3435299b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.212620 Aug 17 20:26:14.442053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 313/634] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:14 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:15.051657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:15.053705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:15.054494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=8 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:15.060256 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:15.060756 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:15.061205 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:15.062001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:15.062471 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:15.063042 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:15.217211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:15.227555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-57376c5b-bce8-4634-a093-f73199e92afc tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.181275 Aug 17 20:26:15.228210 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 322/635] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:15 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:15.469520 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:15.470576 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:15.480056 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:15.480546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:15.480983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:15.481681 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:15.482133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:15.482553 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:15.866058 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:15.875839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a3f89570-3bd4-4e8b-9362-f61560b83228 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.412795 Aug 17 20:26:15.876399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 314/636] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:15 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:16.251834 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:16.252457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:16.262017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:16.263021 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:16.263765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:16.264908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:16.265533 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:16.266012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:16.444899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:16.453760 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-61c7a155-cc2d-4da1-9cb4-a9da448499ba tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.206058 Aug 17 20:26:16.454532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 323/637] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:16 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:16.657996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-55de9b1e-4873-4be9-8f31-f2dcf9f9775f req-a8003d0e-4173-4d20-8fc2-6247032476b7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bab388e-43b0-426b-b624-dc5463b096df", "name": "network-vif-plugged", "status": "completed", "tag": "bb5ad8e5-1428-49b8-a99d-fd470742136f"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:16.670840 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-55de9b1e-4873-4be9-8f31-f2dcf9f9775f req-a8003d0e-4173-4d20-8fc2-6247032476b7 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:16.671441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-55de9b1e-4873-4be9-8f31-f2dcf9f9775f req-a8003d0e-4173-4d20-8fc2-6247032476b7 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:16.671997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-55de9b1e-4873-4be9-8f31-f2dcf9f9775f req-a8003d0e-4173-4d20-8fc2-6247032476b7 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:16.686926 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-55de9b1e-4873-4be9-8f31-f2dcf9f9775f req-a8003d0e-4173-4d20-8fc2-6247032476b7 service nova] Creating event network-vif-plugged:bb5ad8e5-1428-49b8-a99d-fd470742136f for instance 6bab388e-43b0-426b-b624-dc5463b096df on hv-cinder-83538 Aug 17 20:26:16.696295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-55de9b1e-4873-4be9-8f31-f2dcf9f9775f req-a8003d0e-4173-4d20-8fc2-6247032476b7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044408 Aug 17 20:26:16.696295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 315/638] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:16.902891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:16.903793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:16.912832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:16.913573 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:16.914153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:16.915190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:16.915761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:16.916339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:17.132941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:17.148807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-10815da0-869c-4099-84bd-6b7e33ba1eb5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.250824 Aug 17 20:26:17.150338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 324/639] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:16 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:17.478220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:17.479033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:17.485908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:17.486401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:17.486883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:17.487595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:17.488527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:17.488527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:17.651820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:17.660840 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c54f87e0-1eaf-43e5-bef8-7cd0fdb46726 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.187151 Aug 17 20:26:17.661519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 316/640] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:17 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:18.171773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:18.172595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:18.180948 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:18.181707 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:18.182152 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:18.182998 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:18.183509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:18.183990 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:18.342215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:18.354416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e3443fb0-b963-40ed-86e3-95d2b505d0c8 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.186191 Aug 17 20:26:18.355397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 325/641] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:18 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:18.698389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:18.699056 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:18.705663 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:18.706233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:18.706919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:18.707729 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:18.708186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:18.708602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:18.850568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:18.859521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6ea28ce8-9c08-44fc-a03f-2f79c2b0036d tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1319 microversion: 2.1 time: 0.167252 Aug 17 20:26:18.860193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 317/642] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:18 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:19.377525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:19.379167 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:19.386190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:19.386709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:19.387154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:19.388019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:19.388494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:19.389038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:19.572286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:19.582017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-622984ea-aa45-4d8c-8d65-eb3834c7a2f0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.208108 Aug 17 20:26:19.582657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 326/643] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:19 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:19.881569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:19.882180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:19.889119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:19.889600 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:19.890035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:19.890758 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:19.891207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:19.891624 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:20.028590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:20.037184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-46a71e79-79f0-437a-9999-1d36bc9942f9 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1507 microversion: 2.1 time: 0.159654 Aug 17 20:26:20.037754 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 318/644] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:19 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:20.058285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b809deac-9d47-4563-b6bc-e0e1ee53e5f0", "device": "/dev/sdb"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:20.060861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:20.067733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:20.068221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:20.068661 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:20.069436 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:20.069891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:20.070335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:20.616426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:20.617046 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:20.623528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:20.624023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:20.624455 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:20.625416 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:20.625865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:20.626306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:20.768175 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:20.776667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e8ca8d58-9ba8-4b32-8c5a-d3ee788882a0 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.164808 Aug 17 20:26:20.777238 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 319/645] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:20 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:20.910423 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1a17a443-2924-4e86-b689-8485b75af99c tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "POST /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.856127 Aug 17 20:26:20.911307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 327/646] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:26:20 2022] POST /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df/os-volume_attachments => generated 194 bytes in 858 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:21.798975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:21.799565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:21.807778 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:21.808288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:21.808702 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:21.809437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:21.809890 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:21.810309 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:21.971750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:21.987636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2a4557e5-77d2-420f-8477-bc84443c0e10 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.192161 Aug 17 20:26:21.988640 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 320/647] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:21 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:23.012555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:23.013461 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:23.020805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:23.021296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:23.021729 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:23.022439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:23.022917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:23.023338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:23.226308 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:23.226308 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2968dad0-40e6-4252-bbd6-7e2491d2c197 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.171756 Aug 17 20:26:23.226308 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 328/648] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:23 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:24.247242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:24.247837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:24.255437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:24.255918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:24.256350 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:24.257043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:24.257601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:24.258027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:24.399033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:24.407337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bfb4b669-1fc6-4d78-b109-eec825a89a67 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.163934 Aug 17 20:26:24.407839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 321/649] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:24 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:25.429880 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:25.430555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:25.437541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:25.438066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:25.438510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:25.439248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:25.439710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:25.440141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:25.571317 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:25.579662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-46bb2102-05c0-46e9-99a8-a8dbc8058a3d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.153655 Aug 17 20:26:25.580305 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 329/650] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:25 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:26.601387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:26.602035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:26.604488 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=68 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:26.609256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:26.609794 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:26.613534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:26.613534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:26.613534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:26.613534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:26.746546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:26.755297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-14d724ab-d721-4d87-bdff-85b84673aab3 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.157770 Aug 17 20:26:26.755882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 322/651] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:26 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:27.777330 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:27.777934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:27.785392 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:27.785900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:27.786341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:27.787079 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:27.787564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:27.788016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:27.922429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:27.931181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-184e00fd-46b3-41eb-8426-f65b0b9d1cd5 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.157667 Aug 17 20:26:27.931675 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 330/652] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:27 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:28.531350 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:26:28.531892 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Wed Aug 17 20:26:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:26:28.954792 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:28.956347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:28.962527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:28.963054 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:28.963492 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:28.964196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:28.964701 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:28.965118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:29.100382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:29.108495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-582bbbfc-1474-436e-9780-6428b73d2098 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.159078 Aug 17 20:26:29.109098 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 323/653] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:28 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:30.130324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:30.130980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:30.137703 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:30.138191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:30.138612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:30.139312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:30.139759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:30.140179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:30.156115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:30.372766 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:30.382015 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9efee594-a252-4e83-b668-b44207361bc7 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.256239 Aug 17 20:26:30.382651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 331/654] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:30 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:31.403610 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:31.404228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:31.411665 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:31.414966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:31.414966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:31.414966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:31.414966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:31.415405 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:31.547573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:31.556721 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5924c5eb-b4df-4be3-b59b-78881c615423 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.156992 Aug 17 20:26:31.557292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 324/655] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:31 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:32.578183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:32.578826 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:32.585809 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:32.586304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:32.586773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:32.587473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:32.587937 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:32.588362 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:32.724390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:32.732542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-42760491-23ff-4585-9603-5e3570ed77e1 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.158584 Aug 17 20:26:32.733113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 332/656] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:32 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:33.129652 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:26:33.129881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Wed Aug 17 20:26:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:26:33.531216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:33.533514 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:33.540936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:33.541412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:33.541844 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:33.542550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:33.543004 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:33.543416 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:33.575197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-fbfbd84c-ac6d-4f1e-a2ef-b13abed65289 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047938 Aug 17 20:26:33.575649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 325/657] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:26:33 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:26:33.637818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:33.638325 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:33.647669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:33.648238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:33.648690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:33.649394 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:33.649859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:33.650324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:33.676067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:26:33.754248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:33.754897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:33.760900 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:33.761380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:33.761811 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:33.762497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:33.762971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:33.763387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:33.778521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:33.910469 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:33.918705 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-47b23628-8dbe-4a67-ac4e-9218fe69e840 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.168762 Aug 17 20:26:33.919308 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 326/658] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:33 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:34.071517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-16bf8652-d0a2-457c-bc00-4e6370e17d66 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 204 len: 0 microversion: 2.1 time: 0.437260 Aug 17 20:26:34.072097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 333/659] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:26:33 2022] DELETE /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:26:34.080159 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:34.080935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:34.086958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:34.087434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:34.087864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:34.088545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:34.088989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:34.089403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:34.221186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:34.229429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6dfa563d-5fa7-4f8d-95c0-35df050a8007 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1673 microversion: 2.1 time: 0.153009 Aug 17 20:26:34.229994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 327/660] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:34 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:34.942904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:34.943518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:34.949953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:34.950447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:34.950909 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:34.951600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:34.952051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:34.952477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:35.088439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:35.097026 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f6542492-f64e-4a83-83e7-ffa162fcd750 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.158165 Aug 17 20:26:35.097709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 334/661] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:34 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:35.251165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:35.251696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:35.258896 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:35.259382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:35.259819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:35.260515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:35.260973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:35.261398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:35.399309 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:35.406910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3ae0b71b-4a14-49d2-a862-dcf980e80a47 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1673 microversion: 2.1 time: 0.159966 Aug 17 20:26:35.407468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 328/662] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:35 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:36.119512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:36.120196 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:36.127272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:36.127817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:36.128267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:36.129006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:36.129461 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:36.129886 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:36.267316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:36.275969 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0aeeb2ea-5821-40c5-8cc3-71f346a46c1a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.160372 Aug 17 20:26:36.276532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 335/663] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:36 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:36.428793 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:36.429340 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:36.435730 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:36.436213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:36.436654 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:36.437343 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:36.437800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:36.438225 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:36.576042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:36.584606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-314ccf84-5c55-4b8d-b8ad-cc3940634c0a tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1673 microversion: 2.1 time: 0.159910 Aug 17 20:26:36.585252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 329/664] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:36 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:37.297666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:37.298582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:37.300961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:37.306052 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:37.306550 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:37.307035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:37.307775 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:37.308289 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:37.308716 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:37.459516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:37.467962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c563a392-2be5-4ac0-bca0-13432e79cefd tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1734 microversion: 2.1 time: 0.174250 Aug 17 20:26:37.468558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 336/665] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:37 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:37.607482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:37.608075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:37.615153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:37.615649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:37.616080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:37.616787 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:37.617246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:37.617666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:37.758271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:37.766251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-82311a52-ac4e-405c-a56d-777ad2b3e0b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1673 microversion: 2.1 time: 0.163083 Aug 17 20:26:37.767158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 330/666] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:37 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:38.490243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:38.490913 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:38.497476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.497965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.498402 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.499133 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.499846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.500444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.637289 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:38.646575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bd00dcec-a4de-4f3b-9e56-dd8a1acb1105 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1714 microversion: 2.1 time: 0.160719 Aug 17 20:26:38.647188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 337/667] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:38 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:38.709159 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:38.709691 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:38.716098 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.716586 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.717024 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.717715 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.718173 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.718656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.790267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:38.790921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:38.796772 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.797261 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.797683 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.798362 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.798836 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.800365 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.811439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] HTTP exception thrown: Cannot 'detach_volume' instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d while it is in vm_state rescued Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Request method failure captured: Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments/36b934c0-b3fc-4cb5-b1e0-e4eb0744eb96 HTTP/1.1 Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U3Jr6kMmDyuEpMJkIuma3ay9uir9vZ6UI1eyehWoPf6Q27Z8GCZQaywFzJAj-0OF6VyVRBvRf6gVZS8NQkxX2oXcrwXCW0ucrAENIMw3PQ3fKQGRge7pnJpRaUb6pb01_Ys7HIrcCKauhQR4FGK7TuZmSWdSLJiUac7zEyBWXWrOZ8 Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:26:38.813323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 8cacffb3524f4f8ea97946e5e4af1ac3 Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:26:38.815081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Cannot 'detach_volume' instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d while it is in vm_state rescued Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'server_id': '19fb5faa-99aa-4e6a-9d28-c82d7c47222d', 'id': '36b934c0-b3fc-4cb5-b1e0-e4eb0744eb96'} Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:26:38.815817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d while it is in vm_state rescued Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d while it is in vm_state rescued Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:38.817166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Returning 409 to user: Cannot 'detach_volume' instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d while it is in vm_state rescued {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:26:38.818315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7c579601-1871-427c-8258-0da77778e224 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "DELETE /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments/36b934c0-b3fc-4cb5-b1e0-e4eb0744eb96" status: 409 len: 152 microversion: 2.1 time: 0.109646 Aug 17 20:26:38.818315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 331/668] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:26:38 2022] DELETE /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments/36b934c0-b3fc-4cb5-b1e0-e4eb0744eb96 => generated 152 bytes in 111 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 17 20:26:38.823774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:38.825418 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:38.830311 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.831006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.831449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.832298 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:38.832609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:38.833016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:38.950270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:38.958003 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2ebb294a-3d76-4ba2-bb19-deed01b618f3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1673 microversion: 2.1 time: 0.172573 Aug 17 20:26:38.958569 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 338/669] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:38 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1673 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:39.070337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-60a71b64-66a7-462f-9d84-c265efabe345 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "POST /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/action" status: 202 len: 0 microversion: 2.1 time: 0.250027 Aug 17 20:26:39.073914 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 332/670] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:26:38 2022] POST /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/action => generated 0 bytes in 252 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:26:39.079183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:39.079888 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:39.087203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:39.087904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:39.088324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:39.089025 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:39.089474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:39.089888 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:39.228369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:39.237717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-22053f49-5274-430e-bea3-498334167657 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1722 microversion: 2.1 time: 0.162465 Aug 17 20:26:39.244407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 339/671] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:39 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1722 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:26:39.982220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:39.982958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:39.989547 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:39.990041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:39.990482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:39.991237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:39.991696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:39.992141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:40.136847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:40.145769 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6bd4cc5f-f047-44c3-a14a-7409e8c70ef2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1673 microversion: 2.1 time: 0.168153 Aug 17 20:26:40.146502 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 333/672] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:39 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1673 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:40.260022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:40.260783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:40.268756 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:40.269526 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:40.269983 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:40.270729 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:40.271189 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:40.271614 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:40.421817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:40.430974 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8dfe97b9-79ad-4727-a20d-05200cbb0859 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1722 microversion: 2.1 time: 0.174789 Aug 17 20:26:40.431544 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 340/673] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:40 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:40.619056 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-c8ff0f95-759c-4efe-ac36-ee2b2aebd59c req-be0a4e9a-45bc-4468-a814-83c2728536c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f848de82-5bd1-4bf9-b720-8a8fac4ea7cd", "name": "network-vif-deleted", "tag": "8aa64187-8b77-488f-ada3-4985b564cf73"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:40.629948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-c8ff0f95-759c-4efe-ac36-ee2b2aebd59c req-be0a4e9a-45bc-4468-a814-83c2728536c6 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:40.630442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-c8ff0f95-759c-4efe-ac36-ee2b2aebd59c req-be0a4e9a-45bc-4468-a814-83c2728536c6 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:40.630884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-c8ff0f95-759c-4efe-ac36-ee2b2aebd59c req-be0a4e9a-45bc-4468-a814-83c2728536c6 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:40.643514 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-c8ff0f95-759c-4efe-ac36-ee2b2aebd59c req-be0a4e9a-45bc-4468-a814-83c2728536c6 service nova] Creating event network-vif-deleted:8aa64187-8b77-488f-ada3-4985b564cf73 for instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd on hv-cinder-83538 Aug 17 20:26:40.649214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-c8ff0f95-759c-4efe-ac36-ee2b2aebd59c req-be0a4e9a-45bc-4468-a814-83c2728536c6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033741 Aug 17 20:26:40.650260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 334/674] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:41.171554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:41.172655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:41.184922 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:41.185507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:41.186031 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:41.186900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:41.187454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:41.188060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:41.258529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:41.266827 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bf42e813-0610-4fb7-9a54-28520e088023 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1322 microversion: 2.1 time: 0.102516 Aug 17 20:26:41.269534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 341/675] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:41 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1322 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:41.453473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:41.454182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:41.461185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:41.464222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:41.464222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:41.464222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:41.464222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:41.464545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:41.614535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:41.623915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7d2cd335-08d2-4c02-ad93-191624bda417 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1722 microversion: 2.1 time: 0.175178 Aug 17 20:26:41.624753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 335/676] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:41 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:42.214774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:42.215350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:42.222280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:42.222845 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:42.223280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:42.223966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:42.224410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:42.224824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:42.293530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:42.294596 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:42.305231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:42.306082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:42.306996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:42.308023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:42.309063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:42.309815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:42.311252 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lazy-loading 'services' on Instance uuid 6bab388e-43b0-426b-b624-dc5463b096df {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:26:42.379102 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:42.387033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f917d98c-4621-4b6c-b355-304d2b75c690 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1322 microversion: 2.1 time: 0.100907 Aug 17 20:26:42.387611 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 336/677] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:42 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1322 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:42.587274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1d5b0cf2-cbd0-407f-80b7-a62cf6475a12 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df/os-volume_attachments/b809deac-9d47-4563-b6bc-e0e1ee53e5f0" status: 202 len: 0 microversion: 2.1 time: 0.375743 Aug 17 20:26:42.587999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 342/678] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:26:42 2022] DELETE /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df/os-volume_attachments/b809deac-9d47-4563-b6bc-e0e1ee53e5f0 => generated 0 bytes in 378 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:26:42.647261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:42.647905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:42.654572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:42.655137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:42.655609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:42.656312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:42.656798 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:42.657220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:42.808072 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:42.817037 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-24eaa8a0-b567-4ba8-aae0-afbe3bfb62ac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1722 microversion: 2.1 time: 0.175355 Aug 17 20:26:42.817650 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 337/679] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:42 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:43.411153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:43.411927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:43.419563 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:43.420062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:43.420503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:43.421218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:43.421683 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:43.422104 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:43.469741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:43.477448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:43.477448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:43.477448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lazy-loading 'fault' on Instance uuid f848de82-5bd1-4bf9-b720-8a8fac4ea7cd {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:26:43.520378 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:43.527705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-505f33ca-25e3-4e9f-b013-a8010e5700d6 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 200 len: 1327 microversion: 2.1 time: 0.122373 Aug 17 20:26:43.528279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 343/680] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:43 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 1327 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:43.839219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:43.840216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:43.847090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:43.847584 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:43.848030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:43.848749 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:43.849209 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:43.849638 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:43.986296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:43.995198 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3397def0-58b3-4783-9f30-1e0545b19f09 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1728 microversion: 2.1 time: 0.160092 Aug 17 20:26:43.995858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 338/681] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:43 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1728 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:44.016770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:44.017270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:44.023644 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:44.024130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:44.024568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:44.025260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:44.025716 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:44.026141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:44.105172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6a009a21-0f3c-468a-84ac-ff28926f88ce tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092227 Aug 17 20:26:44.105768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 344/682] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:26:44 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:44.552967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:44.553482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:44.560209 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:44.560705 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:44.561142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:44.562041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:44.562503 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:44.562961 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:44.579524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] HTTP exception thrown: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Request method failure captured: Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd HTTP/1.1 Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U3HvhIe9sfdpdlZhaS6xRgExRb7OKx-GYGJHf142NYvUY3M56L7e6oDx8kCfsQyQ5e6IazWBcXVfkfCwtszvUo9tKd9mf91mCUsjpmiu_LLoFfBjjavI4OjsJ0uzocVypqRYH7T_GqEtc4KZMsydhGPAVy8vdusUQl18_N4XMtBSGs Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:26:44.582574 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: acd37d5161b247139f337ef0bf50a764 Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:26:44.584256 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': 'f848de82-5bd1-4bf9-b720-8a8fac4ea7cd'} Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:26:44.585163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:26:44.586507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:44.588161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Returning 404 to user: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:26:44.588161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9ba6f108-3291-4284-ac9e-66044098e265 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 404 len: 111 microversion: 2.1 time: 0.037391 Aug 17 20:26:44.594179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f71be7ac-19d9-43db-bdfc-ae57d3024271 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '.version_select at 0x7f23e1b66700>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:44.598849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 339/683] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:44 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:26:44.687684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f71be7ac-19d9-43db-bdfc-ae57d3024271 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-272915331" status: 202 len: 0 microversion: 2.1 time: 0.096098 Aug 17 20:26:44.694875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 345/684] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 17 20:26:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-272915331 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:26:44.744214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:26:44.744822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Wed Aug 17 20:26:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:26:45.446476 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-2077587c-46af-4ec2-b89d-6c8faf1bea13 req-df0a5b32-bb03-4822-80b5-710806c9d673 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb5faa-99aa-4e6a-9d28-c82d7c47222d", "tag": "161d7ebe-907f-42da-9379-adf417700bb6"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:45.458258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-2077587c-46af-4ec2-b89d-6c8faf1bea13 req-df0a5b32-bb03-4822-80b5-710806c9d673 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:45.462123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-2077587c-46af-4ec2-b89d-6c8faf1bea13 req-df0a5b32-bb03-4822-80b5-710806c9d673 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:45.462123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-2077587c-46af-4ec2-b89d-6c8faf1bea13 req-df0a5b32-bb03-4822-80b5-710806c9d673 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:45.471833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-2077587c-46af-4ec2-b89d-6c8faf1bea13 req-df0a5b32-bb03-4822-80b5-710806c9d673 service nova] Creating event network-changed:161d7ebe-907f-42da-9379-adf417700bb6 for instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d on hv-cinder-83538 Aug 17 20:26:45.477845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-2077587c-46af-4ec2-b89d-6c8faf1bea13 req-df0a5b32-bb03-4822-80b5-710806c9d673 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039668 Aug 17 20:26:45.478484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 340/685] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:45.810434 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c0835384-684c-4526-a159-2b871baad62f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'create', calling method: .version_select at 0x7f23e1b41820>, body: {"keypair": {"name": "tempest-keypair-1385707762", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCHVLdWvNSBoau3pecirvOF26YlNGmxBoYityc4pM8172N4/V9SMn/+IyG1/IjFXGbgv9/mZ5atzS4CocwNDcwrg8s83Kjp2pkzMaHEh1QI6JPt6rZ8P9+QfLAapX8rW1Q=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:45.836269 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-c0835384-684c-4526-a159-2b871baad62f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for project f95e63e2fad24821953b5549e26f9dbd. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:26:45.841275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-c0835384-684c-4526-a159-2b871baad62f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for user acd37d5161b247139f337ef0bf50a764 and project f95e63e2fad24821953b5549e26f9dbd. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:26:45.888161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:45.888761 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:45.895342 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:45.897592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:45.897592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:45.897592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:45.897592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:45.897954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:45.918607 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c0835384-684c-4526-a159-2b871baad62f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112512 Aug 17 20:26:45.919225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 346/686] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:26:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:45.936144 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:26:46.227464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-402100af-9d12-4b2a-9f40-2f8f2bb07041 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 204 len: 0 microversion: 2.1 time: 0.343489 Aug 17 20:26:46.228725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 341/687] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:26:45 2022] DELETE /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 20:26:46.241768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:46.242495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:46.250808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:46.251448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:46.252193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:46.253927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:46.254565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:46.255191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:46.418408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:46.421040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:46.427058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-df83b5d5-b01c-440f-9d21-49f76395d107 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1513 microversion: 2.1 time: 0.193628 Aug 17 20:26:46.427634 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 347/688] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:46 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1513 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:47.449200 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:47.449983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:47.457311 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:47.457808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:47.458263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:47.459019 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:47.459476 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:47.459910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:47.476182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:47.712541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-ab9d8935-75c7-4909-bebe-3f4cb8a873ab req-05d8f118-0a31-4160-b44b-eded1101504e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19fb5faa-99aa-4e6a-9d28-c82d7c47222d", "tag": "161d7ebe-907f-42da-9379-adf417700bb6"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:47.722607 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ab9d8935-75c7-4909-bebe-3f4cb8a873ab req-05d8f118-0a31-4160-b44b-eded1101504e service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:47.723113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ab9d8935-75c7-4909-bebe-3f4cb8a873ab req-05d8f118-0a31-4160-b44b-eded1101504e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:47.723541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ab9d8935-75c7-4909-bebe-3f4cb8a873ab req-05d8f118-0a31-4160-b44b-eded1101504e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:47.739164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-ab9d8935-75c7-4909-bebe-3f4cb8a873ab req-05d8f118-0a31-4160-b44b-eded1101504e service nova] Creating event network-changed:161d7ebe-907f-42da-9379-adf417700bb6 for instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d on hv-cinder-83538 Aug 17 20:26:47.744197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-ab9d8935-75c7-4909-bebe-3f4cb8a873ab req-05d8f118-0a31-4160-b44b-eded1101504e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.104293 Aug 17 20:26:47.744977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 348/689] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:26:47.759265 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:47.767228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2ff241dc-948d-460f-bc9e-5a92cef7976f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1513 microversion: 2.1 time: 0.322356 Aug 17 20:26:47.767840 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 342/690] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:47 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1513 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:48.527124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1480417619", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e44abbe6-3735-455d-be24-2acc87eb2370"}], "security_groups": [{"name": "tempest-securitygroup--2031713340"}], "key_name": "tempest-keypair-1385707762", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:48.638221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] validate_networks() for [('e44abbe6-3735-455d-be24-2acc87eb2370', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:26:48.788379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:48.789006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:48.796413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:48.796904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:48.797338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:48.798075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:48.798491 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:48.798947 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:48.999493 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:49.010788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6e1bc905-61dd-4f60-8659-9af2404afb5e tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1513 microversion: 2.1 time: 0.226194 Aug 17 20:26:49.011523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 343/691] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:48 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:49.147505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:26:49.147979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:26:49.148538 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:26:49.149023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:26:49.149533 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:26:49.160134 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:49.161011 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:49.161535 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:49.162350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:49.162945 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:49.163386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:49.181465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for project f95e63e2fad24821953b5549e26f9dbd. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:26:49.185918 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Getting quotas for user acd37d5161b247139f337ef0bf50a764 and project f95e63e2fad24821953b5549e26f9dbd. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:26:49.197888 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:26:49.200374 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:26:49.371262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fe2f75bd-de0d-4476-b19c-d000cd70aeb0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.848902 Aug 17 20:26:49.371949 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 349/692] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:26:48 2022] POST /compute/v2.1/servers => generated 402 bytes in 851 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:26:49.384498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-53ac2b9a-cd0d-48e7-a4c6-02505b76507e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:49.387034 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-53ac2b9a-cd0d-48e7-a4c6-02505b76507e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:49.461540 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-53ac2b9a-cd0d-48e7-a4c6-02505b76507e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:49.469876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-53ac2b9a-cd0d-48e7-a4c6-02505b76507e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1238 microversion: 2.1 time: 0.089470 Aug 17 20:26:49.470485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 344/693] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:49 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1238 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:49.558213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-d5acab74-133c-4352-b804-1867f2d2d5fa req-188b8b02-05d5-4ce0-a9e6-ad507d4553c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bab388e-43b0-426b-b624-dc5463b096df", "name": "network-vif-deleted", "tag": "bb5ad8e5-1428-49b8-a99d-fd470742136f"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:49.569726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d5acab74-133c-4352-b804-1867f2d2d5fa req-188b8b02-05d5-4ce0-a9e6-ad507d4553c5 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:49.570447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d5acab74-133c-4352-b804-1867f2d2d5fa req-188b8b02-05d5-4ce0-a9e6-ad507d4553c5 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:49.570635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-d5acab74-133c-4352-b804-1867f2d2d5fa req-188b8b02-05d5-4ce0-a9e6-ad507d4553c5 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:49.583070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-d5acab74-133c-4352-b804-1867f2d2d5fa req-188b8b02-05d5-4ce0-a9e6-ad507d4553c5 service nova] Creating event network-vif-deleted:bb5ad8e5-1428-49b8-a99d-fd470742136f for instance 6bab388e-43b0-426b-b624-dc5463b096df on hv-cinder-83538 Aug 17 20:26:49.587895 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-d5acab74-133c-4352-b804-1867f2d2d5fa req-188b8b02-05d5-4ce0-a9e6-ad507d4553c5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093119 Aug 17 20:26:49.588804 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 350/694] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:50.032240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:50.033117 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:50.041197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:50.041688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:50.042129 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:50.042878 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:50.043361 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:50.043787 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:50.076734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:50.077244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:50.077828 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:50.078303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lazy-loading 'fault' on Instance uuid 6bab388e-43b0-426b-b624-dc5463b096df {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:26:50.120526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e62a4adc12f4963b09b495122c0a6d5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11fb3890c76b4b60bac49fdcb8dbb71e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:50.129386 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bc742cef-ac8e-421d-8be0-befdd4c2ff6f tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 200 len: 1309 microversion: 2.1 time: 0.101029 Aug 17 20:26:50.129958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 345/695] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:50 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:50.491389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:50.492136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:50.498528 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:50.499053 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:50.499749 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:50.500460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:50.500920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:50.501350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:50.566281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:50.574141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1cfc5888-1024-4c66-b09d-83ccf69dd7b0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1242 microversion: 2.1 time: 0.087575 Aug 17 20:26:50.574735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 351/696] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:50 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:51.149938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:51.150551 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] [instance: 6bab388e-43b0-426b-b624-dc5463b096df] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:51.157020 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:51.157497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:51.157932 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:51.158955 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:51.159410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:51.159840 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:51.175765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] HTTP exception thrown: Instance 6bab388e-43b0-426b-b624-dc5463b096df could not be found. Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Request method failure captured: Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df HTTP/1.1 Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U5bekyKvbqpyrx_ozXYKuUR2PknKwtMH9k_0FVsjy_5ayQQjDC_Re0exODtEEut6EKgIgGdOEbFmWanekvHF9fisktndgmeSgDZTMfquKoIJ8VEjbAX-fDwvssJMNjV0VzpUJa4fkMhlalrzYDPiXoYkQ4YRXPHAADBM7QYDnBessw Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 11fb3890c76b4b60bac49fdcb8dbb71e Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2111127848 Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:26:51.177394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_11fb3890c76b4b60bac49fdcb8dbb71e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesSnapshotTestJSON-2111127848 Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 11fb3890c76b4b60bac49fdcb8dbb71e Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2111127848 Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesSnapshotTestJSON-2111127848-project Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 4e62a4adc12f4963b09b495122c0a6d5 Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesSnapshotTestJSON-2111127848-project Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 6bab388e-43b0-426b-b624-dc5463b096df could not be found. Aug 17 20:26:51.178910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '6bab388e-43b0-426b-b624-dc5463b096df'} Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6bab388e-43b0-426b-b624-dc5463b096df could not be found. Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:26:51.179725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6bab388e-43b0-426b-b624-dc5463b096df could not be found. Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6bab388e-43b0-426b-b624-dc5463b096df could not be found. Aug 17 20:26:51.181045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:26:51.182323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] Returning 404 to user: Instance 6bab388e-43b0-426b-b624-dc5463b096df could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:26:51.182323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2f90f099-bd30-4140-8f92-8cb13b22a597 tempest-VolumesSnapshotTestJSON-2111127848 tempest-VolumesSnapshotTestJSON-2111127848-project] 10.222.0.64 "GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df" status: 404 len: 111 microversion: 2.1 time: 0.032831 Aug 17 20:26:51.182323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 346/697] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:51 2022] GET /compute/v2.1/servers/6bab388e-43b0-426b-b624-dc5463b096df => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:26:51.595887 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:51.597296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:51.604377 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:51.604863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:51.605331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:51.606073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:51.606525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:51.606981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:51.671381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:51.679794 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e8a81d20-c0e6-4af1-947a-f25d2fa814ed tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1298 microversion: 2.1 time: 0.087836 Aug 17 20:26:51.686044 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 352/698] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:51 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1298 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:52.701644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:52.702934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:52.709677 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:52.710171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:52.710608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:52.711357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:52.711813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:52.712413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:52.856972 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:52.865809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-37e1bf2d-7af7-44ec-8862-947ce5418807 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.168156 Aug 17 20:26:52.866738 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 347/699] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:52 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:53.409089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-6bf9eeab-21b7-490a-a540-7d470f53439c req-7db3611e-0c2a-457a-b85d-e51990735efb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88181da3-87e0-4a41-a592-a73bcf73cf9a", "tag": "581ca84c-ae44-49a9-8153-f96d1e8ef524"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:26:53.423047 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-6bf9eeab-21b7-490a-a540-7d470f53439c req-7db3611e-0c2a-457a-b85d-e51990735efb service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:53.425344 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-6bf9eeab-21b7-490a-a540-7d470f53439c req-7db3611e-0c2a-457a-b85d-e51990735efb service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:53.425344 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-6bf9eeab-21b7-490a-a540-7d470f53439c req-7db3611e-0c2a-457a-b85d-e51990735efb service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:53.438156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-6bf9eeab-21b7-490a-a540-7d470f53439c req-7db3611e-0c2a-457a-b85d-e51990735efb service nova] Creating event network-changed:581ca84c-ae44-49a9-8153-f96d1e8ef524 for instance 88181da3-87e0-4a41-a592-a73bcf73cf9a on hv-cinder-83538 Aug 17 20:26:53.445530 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-6bf9eeab-21b7-490a-a540-7d470f53439c req-7db3611e-0c2a-457a-b85d-e51990735efb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040329 Aug 17 20:26:53.446779 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 353/700] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:26:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:26:53.890992 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:53.891604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:53.898216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:53.898732 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:53.899185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:53.899864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:53.900318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:53.900746 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:54.031847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:54.040216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-58b02f86-ae4b-45ce-bc3b-881c4230600f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.153035 Aug 17 20:26:54.040796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 348/701] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:53 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:55.062771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:55.063381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:55.070252 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:55.070779 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:55.071213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:55.071905 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:55.072360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:55.072784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:55.204953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:55.212727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e2ba9d3d-7afc-4e25-b81a-8880f5e92284 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.154949 Aug 17 20:26:55.213299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 354/702] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:55 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:56.234977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:56.235563 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:56.242813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.243303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.243746 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.244447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.244934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.245333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.394229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:56.397161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-05c58a4f-5ad1-4072-912a-eec1047e0d63 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.166454 Aug 17 20:26:56.398055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 349/703] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:56 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:56.419238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:56.419796 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:56.427377 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.428064 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.435248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.435248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.435248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.435248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.462307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9bfd69d0-1c95-495c-952e-a04b81d46692 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments/5c0f7dc0-9243-477e-831a-e2de63f7d593" status: 200 len: 194 microversion: 2.20 time: 0.047212 Aug 17 20:26:56.462957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 355/704] 10.222.0.64 () {60 vars in 1454 bytes} [Wed Aug 17 20:26:56 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments/5c0f7dc0-9243-477e-831a-e2de63f7d593 => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:26:56.534029 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:56.534526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:56.541124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.541613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.542072 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.542806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.543357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.543775 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.627857 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lazy-loading 'services' on Instance uuid 43150116-1ad7-4a0c-b292-98ee4307770d {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:26:56.830850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-75dad78a-b7a8-4534-9574-1cb46c94a841 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments/5c0f7dc0-9243-477e-831a-e2de63f7d593" status: 202 len: 0 microversion: 2.20 time: 0.301098 Aug 17 20:26:56.831472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 350/705] 10.222.0.64 () {60 vars in 1457 bytes} [Wed Aug 17 20:26:56 2022] DELETE /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments/5c0f7dc0-9243-477e-831a-e2de63f7d593 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:26:56.840063 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:56.844160 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:56.850682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.851176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.851610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.852310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:56.852765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:56.853175 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:56.886550 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-228e82ae-76c0-480b-a4fe-5fd60c78e585 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050537 Aug 17 20:26:56.887144 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 356/706] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 17 20:26:56 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:26:57.419298 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:57.419986 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:57.421879 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:57.427939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:57.428425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:57.430048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:57.430048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:57.430214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:57.430531 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:57.577949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:57.587512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c3a95cf0-41fd-4d1d-84b1-e856a029de6c tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.172822 Aug 17 20:26:57.588086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 351/707] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:57 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:57.899051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:57.901229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:57.907699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:57.908709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:57.909485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:57.910201 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:57.910650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:57.911077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:57.942999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-adeec0bc-372c-49cd-ae87-3408e9d03a38 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047702 Aug 17 20:26:57.943479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 357/708] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 17 20:26:57 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:26:58.609607 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:58.610219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:58.617461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:58.628464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:58.628464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:58.628464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:58.628464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:58.628869 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:58.757149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:58.768119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3629f8bf-6be4-4175-86e8-c8fd4d517bde tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.161904 Aug 17 20:26:58.768709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 352/709] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:58 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:26:58.956773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:58.958992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:58.965817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:58.966298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:58.966778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:58.967472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:58.967916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:58.968331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:59.001164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b541b165-ae96-4040-81a2-8fd79e712849 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049367 Aug 17 20:26:59.001832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 358/710] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 17 20:26:58 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:26:59.790272 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:26:59.790836 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:26:59.792696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:26:59.797883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:59.798362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:59.798885 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:59.799575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:26:59.802783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:26:59.802783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:26:59.934717 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:26:59.943104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-074202da-2ed2-47e4-8f5b-349c26930742 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.156791 Aug 17 20:26:59.943674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 353/711] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:26:59 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:00.013610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:00.015839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:00.018867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:00.019534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=10 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:00.024725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.025206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.025639 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:00.026356 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.026836 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.027268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:00.056527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5e74e662-3f5e-487a-b8d7-86a2a36ce343 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046975 Aug 17 20:27:00.057120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 359/712] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 17 20:27:00 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:00.120577 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:00.121074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:00.128381 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.128864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.129465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:00.130164 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.130617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.131064 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:00.160231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:27:00.471631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-414698e0-3378-45d6-8524-de3d6c70cabe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 204 len: 0 microversion: 2.20 time: 0.354471 Aug 17 20:27:00.472228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 354/713] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 17 20:27:00 2022] DELETE /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 0 bytes in 356 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:27:00.481859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:00.482469 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:00.489515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.490002 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.490491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:00.491318 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.491781 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.492208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:00.632140 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:00.640621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:00.642181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:00.643515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-482bedf6-5a2f-4d1a-9def-16448a3132fb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.166513 Aug 17 20:27:00.644100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 360/714] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:00 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:00.965645 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:00.966573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:00.975102 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.977385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.977385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:00.977385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:00.977385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:00.977829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:01.117931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:01.125802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7bc2996d-b418-4923-964d-806cbf1d22ce tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.164688 Aug 17 20:27:01.126375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 355/715] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:00 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:01.669645 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:01.670267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:01.677680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:01.679653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:01.679653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:01.679653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:01.680006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:01.680372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:01.815770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:01.823912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:01.825433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:01.826605 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-96aaacfc-f7a9-4241-8493-8654667f886f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.161119 Aug 17 20:27:01.827181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 361/716] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:01 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:02.148115 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:02.148752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:02.155213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:02.155695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:02.156128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:02.156819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:02.157272 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:02.157700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:02.289186 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:02.296664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-85745ed2-7e29-48d9-a87b-3ec90636bc07 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.152535 Aug 17 20:27:02.297233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 356/717] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:02 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:02.852097 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:02.852762 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:02.861025 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:02.861706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:02.862155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:02.862930 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:02.863409 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:02.863833 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:02.995879 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-cdf83829-0edc-49ac-8504-dd3b8fe25506 req-d875a197-41b5-48da-baf6-4a65e6290f6d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88181da3-87e0-4a41-a592-a73bcf73cf9a", "name": "network-vif-plugged", "status": "completed", "tag": "581ca84c-ae44-49a9-8153-f96d1e8ef524"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:03.008841 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-cdf83829-0edc-49ac-8504-dd3b8fe25506 req-d875a197-41b5-48da-baf6-4a65e6290f6d service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:03.009556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-cdf83829-0edc-49ac-8504-dd3b8fe25506 req-d875a197-41b5-48da-baf6-4a65e6290f6d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:03.010317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-cdf83829-0edc-49ac-8504-dd3b8fe25506 req-d875a197-41b5-48da-baf6-4a65e6290f6d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:03.024604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:03.033958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-cdf83829-0edc-49ac-8504-dd3b8fe25506 req-d875a197-41b5-48da-baf6-4a65e6290f6d service nova] Creating event network-vif-plugged:581ca84c-ae44-49a9-8153-f96d1e8ef524 for instance 88181da3-87e0-4a41-a592-a73bcf73cf9a on hv-cinder-83538 Aug 17 20:27:03.039392 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-cdf83829-0edc-49ac-8504-dd3b8fe25506 req-d875a197-41b5-48da-baf6-4a65e6290f6d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121187 Aug 17 20:27:03.040231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 357/718] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:27:03.042719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:03.044339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:03.045728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b05d0ec1-bf18-4c85-9f21-44b4431eb0a9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1723 microversion: 2.20 time: 0.198051 Aug 17 20:27:03.046337 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 362/719] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:02 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1723 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:03.318794 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:03.319494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:03.325926 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:03.326447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:03.326911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:03.327783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:03.328245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:03.328670 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:03.481391 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-e9b5e121-bbd4-4a80-af12-34e185100086 req-2397cab6-02a9-4682-9c87-d5972380d6df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43150116-1ad7-4a0c-b292-98ee4307770d", "name": "network-vif-deleted", "tag": "450fc8d5-29fd-4e49-8e9e-caca2f42f264"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:03.494944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e9b5e121-bbd4-4a80-af12-34e185100086 req-2397cab6-02a9-4682-9c87-d5972380d6df service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:03.495727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e9b5e121-bbd4-4a80-af12-34e185100086 req-2397cab6-02a9-4682-9c87-d5972380d6df service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:03.496904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e9b5e121-bbd4-4a80-af12-34e185100086 req-2397cab6-02a9-4682-9c87-d5972380d6df service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:03.534206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-e9b5e121-bbd4-4a80-af12-34e185100086 req-2397cab6-02a9-4682-9c87-d5972380d6df service nova] Creating event network-vif-deleted:450fc8d5-29fd-4e49-8e9e-caca2f42f264 for instance 43150116-1ad7-4a0c-b292-98ee4307770d on hv-cinder-83538 Aug 17 20:27:03.540603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:03.540850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-e9b5e121-bbd4-4a80-af12-34e185100086 req-2397cab6-02a9-4682-9c87-d5972380d6df service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062403 Aug 17 20:27:03.541827 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 363/720] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:27:03.543585 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:03.550838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ecc2e02a-eba3-45c8-941e-9bf3e0747b34 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.236475 Aug 17 20:27:03.551463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 358/721] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:03 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:04.072675 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:04.073273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:04.079502 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:04.080523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:04.080961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:04.081662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:04.082113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:04.082571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:04.162012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:04.170692 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:04.172243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:04.174521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a1039df6-9d13-43b5-a27c-bb301b3840f6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1655 microversion: 2.20 time: 0.105616 Aug 17 20:27:04.175062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 364/722] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:04 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1655 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:04.575970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:04.577182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:04.591273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:04.592144 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:04.592914 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:04.593962 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:04.594839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:04.595653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:04.786171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:04.794222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2675d0c5-a27d-4c85-b2f8-72bb7a97d2cb tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.225062 Aug 17 20:27:04.795192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 359/723] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:04 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:05.197567 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:05.198179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:05.205726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:05.206222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:05.206690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:05.207408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:05.207871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:05.208301 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:05.278304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:05.301092 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:05.304654 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:05.307430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f98a6552-2d92-449e-82f4-15a352f35c61 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1655 microversion: 2.20 time: 0.113265 Aug 17 20:27:05.310232 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 365/724] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:05 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1655 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:05.815960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:05.816572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:05.823347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:05.823833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:05.824261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:05.824957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:05.825403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:05.825815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:05.964027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:05.972508 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a5be6cf2-2a6e-4357-add6-b5badaa5e49e tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.160942 Aug 17 20:27:05.985481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 360/725] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:05 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:06.269451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2080639136"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:06.270082 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:06.276607 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:06.277142 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:06.277572 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:06.278268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:06.278758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:06.282788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:06.348625 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:06.349377 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:06.355937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:06.357413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:06.357413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:06.357891 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:06.358339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:06.358791 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:06.435872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.network.security_group_api [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Removing security group 5fbc29df-ab18-400f-aba1-ca1d7888a4aa from port f0e62279-9fc9-42ea-903e-170912670383 Aug 17 20:27:06.439648 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:06.448074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:06.449605 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:06.450795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8592325a-8c68-425b-ad12-eec355a4cad2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1365 microversion: 2.20 time: 0.106658 Aug 17 20:27:06.451365 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 361/726] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:06 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1365 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:27:06.839306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-752cb3b7-93e7-4fa1-9913-b499ee82aa2b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/action" status: 202 len: 0 microversion: 2.1 time: 0.574036 Aug 17 20:27:06.840389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 366/727] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:27:06 2022] POST /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/action => generated 0 bytes in 575 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:27:06.871189 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-30ef1d33-fa3a-4f30-aae7-e34a9bb5dffe req-baba3367-b8bf-4794-b6ec-2cff648c51f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e3ec09-78c6-4fcf-9fac-045735e18468", "tag": "f0e62279-9fc9-42ea-903e-170912670383"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:06.886112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-30ef1d33-fa3a-4f30-aae7-e34a9bb5dffe req-baba3367-b8bf-4794-b6ec-2cff648c51f7 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:06.886830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-30ef1d33-fa3a-4f30-aae7-e34a9bb5dffe req-baba3367-b8bf-4794-b6ec-2cff648c51f7 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:06.887412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-30ef1d33-fa3a-4f30-aae7-e34a9bb5dffe req-baba3367-b8bf-4794-b6ec-2cff648c51f7 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:06.900713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-30ef1d33-fa3a-4f30-aae7-e34a9bb5dffe req-baba3367-b8bf-4794-b6ec-2cff648c51f7 service nova] Creating event network-changed:f0e62279-9fc9-42ea-903e-170912670383 for instance 74e3ec09-78c6-4fcf-9fac-045735e18468 on hv-cinder-83538 Aug 17 20:27:06.907087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-30ef1d33-fa3a-4f30-aae7-e34a9bb5dffe req-baba3367-b8bf-4794-b6ec-2cff648c51f7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039242 Aug 17 20:27:06.909011 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 362/728] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:06.993263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:06.994023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:07.011534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:07.012383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:07.014493 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:07.015472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:07.034887 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:07.036302 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:07.294055 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:07.305411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f93e4089-3098-497b-b9cf-74d9bb817bf7 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1364 microversion: 2.1 time: 0.315862 Aug 17 20:27:07.306139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 367/729] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:06 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1364 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:07.475151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:07.475956 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:07.482287 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:07.482798 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:07.483240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:07.483935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:07.484392 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:07.484818 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:07.516913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:07.517450 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:07.517875 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:07.518332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lazy-loading 'fault' on Instance uuid 43150116-1ad7-4a0c-b292-98ee4307770d {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:07.579240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:07.588880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:07.590556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:07.591799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-39dd39d8-fdac-4766-9ad2-215ab3633a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 200 len: 1370 microversion: 2.20 time: 0.122114 Aug 17 20:27:07.592419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 363/730] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:07 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 1370 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:08.257454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:08.257957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:08.266272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=89,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:08.269816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.269816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.270084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.270987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.271612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.272200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.279499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:08.330191 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:08.331575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:08.339088 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.344636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.344636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.344636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.344636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.345261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.367248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lazy-loading 'services' on Instance uuid 74e3ec09-78c6-4fcf-9fac-045735e18468 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:08.534146 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:08.543771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-38bcde95-ecef-428b-97d6-bad782eb93e1 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1551 microversion: 2.1 time: 0.217845 Aug 17 20:27:08.549347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 364/731] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:08 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1551 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:08.619072 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:08.619657 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:08.627021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.627385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.627832 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.628658 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.629121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.629603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.670461 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-18d22f78-9180-46ad-b8b2-68d6b3794c72 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments/0003d6c6-4c5f-44c2-a976-f1786a4eb8b8" status: 202 len: 0 microversion: 2.1 time: 0.417019 Aug 17 20:27:08.671388 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 368/732] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:27:08 2022] DELETE /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments/0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:27:08.681436 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:08.682410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:08.689910 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.690813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.691441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.692164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.692773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.693358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.709751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] HTTP exception thrown: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Request method failure captured: Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d HTTP/1.1 Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U4w2cPQyeVVR5zJbaM6sXGIdE9wPe0QxiU2OcPsJfWjB7-d2J7So_JMedzfkGV9pQWR8aExntsA1l-C951ygWuemObc-MtZseXFGnTmnScQ0jXd_sdJAZH9sBGfnXGEhntfMuSYMcxL9KnDxNu7WhQQcv_dzEkZT4MibVHV3e358bw Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:27:08.711940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 3355014e725048949595575341c69c9c Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:27:08.713521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '43150116-1ad7-4a0c-b292-98ee4307770d'} Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:27:08.714494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:27:08.715727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:08.718040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Returning 404 to user: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:27:08.719171 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-357ed031-cb7e-40dd-b116-6642a20e7917 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 404 len: 111 microversion: 2.20 time: 0.046512 Aug 17 20:27:08.722672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 369/733] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:08 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:27:08.725754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:08.728070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:08.736660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.736660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.737297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.737796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3e828550-c128-4734-851a-5beddc1a5fdc tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120557 Aug 17 20:27:08.738035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:08.745389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:08.745602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 365/734] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:27:08 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-interface => generated 285 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:27:08.745705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:08.745792 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1cae5d05-f866-409b-b841-ee4b9f56d1c8 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '.version_select at 0x7f23e1c1e1f0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:08.775197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7790ae73-5df8-4925-ac07-e32183337585 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053466 Aug 17 20:27:08.775839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 370/735] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:08 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:08.905848 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1cae5d05-f866-409b-b841-ee4b9f56d1c8 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-779561908" status: 204 len: 0 microversion: 2.20 time: 0.159137 Aug 17 20:27:08.914354 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 366/736] 10.222.0.64 () {60 vars in 1259 bytes} [Wed Aug 17 20:27:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-779561908 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:27:09.016491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-dc454278-848e-4d2f-b6ec-38dc0a541f7e req-3a356dab-b5ac-4994-ab29-8bf43975cc19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74e3ec09-78c6-4fcf-9fac-045735e18468", "tag": "f0e62279-9fc9-42ea-903e-170912670383"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:09.027485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dc454278-848e-4d2f-b6ec-38dc0a541f7e req-3a356dab-b5ac-4994-ab29-8bf43975cc19 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:09.028235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dc454278-848e-4d2f-b6ec-38dc0a541f7e req-3a356dab-b5ac-4994-ab29-8bf43975cc19 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:09.028914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dc454278-848e-4d2f-b6ec-38dc0a541f7e req-3a356dab-b5ac-4994-ab29-8bf43975cc19 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:09.045245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-dc454278-848e-4d2f-b6ec-38dc0a541f7e req-3a356dab-b5ac-4994-ab29-8bf43975cc19 service nova] Creating event network-changed:f0e62279-9fc9-42ea-903e-170912670383 for instance 74e3ec09-78c6-4fcf-9fac-045735e18468 on hv-cinder-83538 Aug 17 20:27:09.055956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-dc454278-848e-4d2f-b6ec-38dc0a541f7e req-3a356dab-b5ac-4994-ab29-8bf43975cc19 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042632 Aug 17 20:27:09.057345 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 371/737] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:09.156897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:09.157189 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:09.163891 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:09.164768 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:09.165391 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:09.166118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:09.166580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:09.167033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:09.203968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lazy-loading 'flavor' on Instance uuid 78a86ddd-90d5-466f-8a34-6cc8d6d30690 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:09.608193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7986b57b-2f9c-439e-ba02-78dfcb5d02c3 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "POST /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690/action" status: 202 len: 0 microversion: 2.1 time: 0.455519 Aug 17 20:27:09.609550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 367/738] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:27:09 2022] POST /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690/action => generated 0 bytes in 458 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:27:09.634872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:09.636549 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:09.644717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:09.645465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:09.645903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:09.646869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:09.647497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:09.647930 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:09.788471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:09.790953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:09.797862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:09.798805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:09.799537 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:09.800402 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:09.800864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:09.801282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:09.841858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3c2c1ad7-a700-4f0c-a7fc-9f54d0d02db1 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058235 Aug 17 20:27:09.847109 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 368/739] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:09 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:09.866022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:09.874744 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-467202bb-f771-47c2-b92e-00a669b89c40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.260907 Aug 17 20:27:09.875285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 372/740] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:09 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:10.002284 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-068a18b6-2663-429f-b077-95efd329dd8f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'create', calling method: .version_select at 0x7f23e1caf790>, body: {"keypair": {"name": "tempest-keypair-90210224", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKmsXktkw5TV2doCs1siigNIo28t6+KQpGYTu+5K0apJ8nRI2TfXo/IqRCCsU62IcIRBs2WcCn1Bk7Jak7o5srnNVDscfi+MX45qhfPOXTesUOYUOo9RkSI3KlB4u0942A=="}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:10.019588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-068a18b6-2663-429f-b077-95efd329dd8f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for project 7052604e37f4405bb5ccf8ffff694369. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:27:10.023756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-068a18b6-2663-429f-b077-95efd329dd8f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for user 3355014e725048949595575341c69c9c and project 7052604e37f4405bb5ccf8ffff694369. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:27:10.140564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-068a18b6-2663-429f-b077-95efd329dd8f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.142753 Aug 17 20:27:10.141168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 369/741] 10.222.0.64 () {62 vars in 1200 bytes} [Wed Aug 17 20:27:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 144 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 17 20:27:10.854934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:10.857133 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:10.864753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:10.865235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:10.865665 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:10.866355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:10.866827 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:10.867239 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:10.898443 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:10.899058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-61348483-dae4-45f3-b0c2-52cbf34fc730 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047436 Aug 17 20:27:10.899253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:10.904713 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 373/742] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:10 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:27:10.908889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:10.908889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:10.909733 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:10.910216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:10.910743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:10.911560 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:10.912230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:10.912848 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:10.916759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:10.917460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:10.918047 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:10.918935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:10.919531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:10.920102 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:11.007186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] HTTP exception thrown: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 is not attached to volume 0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Request method failure captured: Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments/0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 HTTP/1.1 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U4w4QIyVVBXU9X0b3JD983nHDU2-Cn2E9L5mB0H7azDGS6_yItPTPhS8MjhEXUHmLoydpu5JSnHxxFxoDRP8BsR9ZqAScF269TaxFKBTH2VC_dFmjfHLi5Dwd5USkNAwckde_Y7DK0rhnYi9jCVQyIvcaEojt4Juuda22uxDvZH3E0 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 6f2054a9c9ff437c8aceef06d0043526 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-TestMinimumBasicScenario-916110649 Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:27:11.009666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-TestMinimumBasicScenario-916110649 Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 6f2054a9c9ff437c8aceef06d0043526 Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-TestMinimumBasicScenario-916110649 Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-TestMinimumBasicScenario-916110649-project Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d8e620b4ca454bc5a6a19ae55138d861 Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-TestMinimumBasicScenario-916110649-project Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:27:11.011266 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 is not attached to volume 0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'server_id': '74e3ec09-78c6-4fcf-9fac-045735e18468', 'id': '0003d6c6-4c5f-44c2-a976-f1786a4eb8b8'} Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 0003d6c6-4c5f-44c2-a976-f1786a4eb8b8. Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:27:11.012109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 is not attached to volume 0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 is not attached to volume 0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:11.013479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Returning 404 to user: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 is not attached to volume 0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:27:11.014456 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9983d63d-0e8c-4ac3-bd74-7c217c03c2d0 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments/0003d6c6-4c5f-44c2-a976-f1786a4eb8b8" status: 404 len: 154 microversion: 2.1 time: 0.106481 Aug 17 20:27:11.017972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 374/743] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:27:10 2022] DELETE /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468/os-volume_attachments/0003d6c6-4c5f-44c2-a976-f1786a4eb8b8 => generated 154 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:27:11.078746 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:11.087126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3bbec4f8-ebed-40a2-8a3f-52989508b700 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.192618 Aug 17 20:27:11.087916 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 370/744] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:10 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:11.348340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-82886ae7-d053-4180-b152-263e7d438463 req-ab90c458-ed03-45bd-88f2-ad00426fd52d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "88181da3-87e0-4a41-a592-a73bcf73cf9a", "tag": "581ca84c-ae44-49a9-8153-f96d1e8ef524"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:11.358221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-82886ae7-d053-4180-b152-263e7d438463 req-ab90c458-ed03-45bd-88f2-ad00426fd52d service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:11.361372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-82886ae7-d053-4180-b152-263e7d438463 req-ab90c458-ed03-45bd-88f2-ad00426fd52d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:11.361372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-82886ae7-d053-4180-b152-263e7d438463 req-ab90c458-ed03-45bd-88f2-ad00426fd52d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:11.374342 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-82886ae7-d053-4180-b152-263e7d438463 req-ab90c458-ed03-45bd-88f2-ad00426fd52d service nova] Creating event network-changed:581ca84c-ae44-49a9-8153-f96d1e8ef524 for instance 88181da3-87e0-4a41-a592-a73bcf73cf9a on hv-cinder-83538 Aug 17 20:27:11.379939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-82886ae7-d053-4180-b152-263e7d438463 req-ab90c458-ed03-45bd-88f2-ad00426fd52d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041457 Aug 17 20:27:11.380532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 375/745] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:12.109056 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:12.109590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:12.117211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:12.119504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:12.119504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:12.119504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:12.120752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:12.121193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:12.300560 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:12.308533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-65f0090c-00ed-49c2-bd2c-9cdc1544efc5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.203377 Aug 17 20:27:12.309113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 371/746] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:12 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:12.330548 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:12.331153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:12.337354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:12.337903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:12.339191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:12.339191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:12.339824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:12.341280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:12.368170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:27:12.688578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-558a9bb5-dec9-46d2-aed5-305bfe1d4072 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "DELETE /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 204 len: 0 microversion: 2.1 time: 0.362992 Aug 17 20:27:12.690186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 376/747] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:27:12 2022] DELETE /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:27:12.699147 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:12.699769 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:12.706348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:12.706865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:12.707296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:12.708024 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:12.708656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:12.708993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:12.855713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:12.864149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-fc1a890a-fda9-4000-8c96-4d53c63f9566 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1556 microversion: 2.1 time: 0.169300 Aug 17 20:27:12.865087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 372/748] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:12 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1556 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:12.899606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1628397329", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9b5a2268-95a7-4ac8-b93b-e80001b58f38"}], "security_groups": [{"name": "tempest-securitygroup--602109716"}], "key_name": "tempest-keypair-90210224", "user_data": "}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:13.012540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] validate_networks() for [('9b5a2268-95a7-4ac8-b93b-e80001b58f38', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:27:13.331901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:13.332475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:13.338591 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:13.339105 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:13.339543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:13.340240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:13.340732 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:13.341158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:13.442286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:27:13.442787 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:27:13.443320 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:27:13.443631 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:27:13.444038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:27:13.453745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:13.454829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:13.455264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:13.455989 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:13.456437 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:13.456959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:13.475184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for project 7052604e37f4405bb5ccf8ffff694369. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:27:13.479216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Getting quotas for user 3355014e725048949595575341c69c9c and project 7052604e37f4405bb5ccf8ffff694369. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:27:13.490784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:27:13.493185 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:27:13.502839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:13.522857 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-303c041b-0cf0-4824-881c-c6638299b8f6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.195752 Aug 17 20:27:13.523441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 373/749] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:13 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:13.604264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ff707507-3cac-43e3-9367-bafbbb8a5784 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.709484 Aug 17 20:27:13.604901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 377/750] 10.222.0.64 () {62 vars in 1188 bytes} [Wed Aug 17 20:27:12 2022] POST /compute/v2.1/servers => generated 401 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 17 20:27:13.623082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e0e6a7bb-4c4d-43f1-9edc-2561d73dfe92 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:13.623689 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e0e6a7bb-4c4d-43f1-9edc-2561d73dfe92 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:13.681149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e0e6a7bb-4c4d-43f1-9edc-2561d73dfe92 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:13.688388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e0e6a7bb-4c4d-43f1-9edc-2561d73dfe92 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:13.691970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e0e6a7bb-4c4d-43f1-9edc-2561d73dfe92 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:13.698855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e0e6a7bb-4c4d-43f1-9edc-2561d73dfe92 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1280 microversion: 2.20 time: 0.072978 Aug 17 20:27:13.698855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 374/751] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:13 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1280 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:13.888801 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:13.889568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:13.896961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:13.897458 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:13.897911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:13.898622 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:13.899197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:13.899629 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:14.040947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:14.049130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ff82ccc5-7ffb-4992-b049-affef866f286 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1556 microversion: 2.1 time: 0.165459 Aug 17 20:27:14.049769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 378/752] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:13 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:14.545947 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:14.546662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:14.554924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:14.555412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:14.555853 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:14.556564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:14.557017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:14.557440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:14.696324 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:14.703805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dfad457e-cfab-472c-a414-67f261d52937 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.163451 Aug 17 20:27:14.705009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 375/753] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:14 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:14.715721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:14.716487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:14.723300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:14.723788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:14.724227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:14.724925 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:14.725393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:14.725846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:14.787618 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:14.795612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:14.797180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:14.798231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8d63b08d-3513-40a6-93ce-2c0c251be601 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1284 microversion: 2.20 time: 0.086740 Aug 17 20:27:14.798849 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 379/754] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:14 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1284 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:15.070972 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:15.071590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:15.077931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:15.078429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:15.079048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:15.080063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:15.080816 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:15.081428 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:15.232997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:15.242216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2ca7264b-a978-43d1-8c27-4fe70811a244 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1556 microversion: 2.1 time: 0.175575 Aug 17 20:27:15.242718 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 376/755] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:15 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:15.670105 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-147cb78f-dd6b-4d8c-9887-2d0d82129201 req-3ee11fb0-08bd-49bd-87e0-3993f261dfd0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74e3ec09-78c6-4fcf-9fac-045735e18468", "name": "network-vif-deleted", "tag": "f0e62279-9fc9-42ea-903e-170912670383"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:15.681556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-147cb78f-dd6b-4d8c-9887-2d0d82129201 req-3ee11fb0-08bd-49bd-87e0-3993f261dfd0 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:15.681556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-147cb78f-dd6b-4d8c-9887-2d0d82129201 req-3ee11fb0-08bd-49bd-87e0-3993f261dfd0 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:15.681858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-147cb78f-dd6b-4d8c-9887-2d0d82129201 req-3ee11fb0-08bd-49bd-87e0-3993f261dfd0 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:15.693707 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-147cb78f-dd6b-4d8c-9887-2d0d82129201 req-3ee11fb0-08bd-49bd-87e0-3993f261dfd0 service nova] Creating event network-vif-deleted:f0e62279-9fc9-42ea-903e-170912670383 for instance 74e3ec09-78c6-4fcf-9fac-045735e18468 on hv-cinder-83538 Aug 17 20:27:15.698698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-147cb78f-dd6b-4d8c-9887-2d0d82129201 req-3ee11fb0-08bd-49bd-87e0-3993f261dfd0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032209 Aug 17 20:27:15.702329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 380/756] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:15.725884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:15.726500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:15.733329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:15.733821 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:15.734252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:15.734982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:15.736077 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:15.736957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:15.739956 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:15.822124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:15.822815 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:15.829136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:15.829763 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:15.830204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:15.830927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:15.831390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:15.831816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:15.889183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:15.900556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3b579bd0-b095-4cbb-a72b-3687529e229d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.178772 Aug 17 20:27:15.901197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 377/757] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:15 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:15.906974 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:15.917694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:15.919246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:15.920353 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c05e1be7-d041-4cc6-8fb7-9eaeccfdf159 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1332 microversion: 2.20 time: 0.103094 Aug 17 20:27:15.920912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 381/758] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:15 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1332 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:27:16.265199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:16.265814 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:16.272455 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:16.272944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:16.273380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:16.274084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:16.274549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:16.274999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:16.308849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:16.309395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:16.309826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:16.310273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lazy-loading 'fault' on Instance uuid 74e3ec09-78c6-4fcf-9fac-045735e18468 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:16.354735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd8e620b4ca454bc5a6a19ae55138d861', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2054a9c9ff437c8aceef06d0043526', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:16.363767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-91a37bfc-d0df-4fb7-b8ea-1bcf9adf7ab6 tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 200 len: 1349 microversion: 2.1 time: 0.102773 Aug 17 20:27:16.364344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 378/759] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:16 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 1349 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:16.924269 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:16.924905 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:16.931304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:16.932814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:16.933272 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:16.934001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:16.934653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:16.935128 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:16.951309 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:16.951928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:16.959136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:16.959843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:16.960231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:16.960965 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:16.961603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:16.962031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:17.043511 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:17.053223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:17.054966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:17.056035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ce5ae30d-df09-463e-9a29-b871b799a616 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1338 microversion: 2.20 time: 0.109267 Aug 17 20:27:17.056589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 379/760] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:16 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1338 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:27:17.117322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:17.127335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-aa8045c5-3642-4c08-8f7c-4cd25d45a540 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.207860 Aug 17 20:27:17.128212 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 382/761] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:16 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:17.385341 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:17.385982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] [instance: 74e3ec09-78c6-4fcf-9fac-045735e18468] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:17.392863 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:17.393601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:17.394002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:17.394782 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:17.395245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:17.395679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:17.410181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] HTTP exception thrown: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 could not be found. Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Request method failure captured: Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 HTTP/1.1 Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U4w4QIyVVBXU9X0b3JD983nHDU2-Cn2E9L5mB0H7azDGS6_yItPTPhS8MjhEXUHmLoydpu5JSnHxxFxoDRP8BsR9ZqAScF269TaxFKBTH2VC_dFmjfHLi5Dwd5USkNAwckde_Y7DK0rhnYi9jCVQyIvcaEojt4Juuda22uxDvZH3E0 Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 6f2054a9c9ff437c8aceef06d0043526 Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-TestMinimumBasicScenario-916110649 Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:27:17.411886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6f2054a9c9ff437c8aceef06d0043526"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-TestMinimumBasicScenario-916110649 Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 6f2054a9c9ff437c8aceef06d0043526 Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-TestMinimumBasicScenario-916110649 Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-TestMinimumBasicScenario-916110649-project Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d8e620b4ca454bc5a6a19ae55138d861 Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-TestMinimumBasicScenario-916110649-project Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 could not be found. Aug 17 20:27:17.413425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '74e3ec09-78c6-4fcf-9fac-045735e18468'} Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 could not be found. Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:27:17.414297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 could not be found. Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 could not be found. Aug 17 20:27:17.415728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:17.417042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Returning 404 to user: Instance 74e3ec09-78c6-4fcf-9fac-045735e18468 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:27:17.417042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-332e2f37-6e31-410a-9211-53b377079cdc tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468" status: 404 len: 111 microversion: 2.1 time: 0.032467 Aug 17 20:27:17.417220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 380/762] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:17 2022] GET /compute/v2.1/servers/74e3ec09-78c6-4fcf-9fac-045735e18468 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:27:17.422038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-169b25f2-71d3-45d1-bf45-f83aef2d100b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] Calling method '.version_select at 0x7f23e1ba11f0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:17.519571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-169b25f2-71d3-45d1-bf45-f83aef2d100b tempest-TestMinimumBasicScenario-916110649 tempest-TestMinimumBasicScenario-916110649-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1347997442" status: 202 len: 0 microversion: 2.1 time: 0.101230 Aug 17 20:27:17.520446 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 383/763] 10.222.0.64 () {58 vars in 1272 bytes} [Wed Aug 17 20:27:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1347997442 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:27:18.090356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:18.091014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:18.097949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:18.098427 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:18.098886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:18.099575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:18.100054 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:18.100474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:18.149484 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:18.150093 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:18.156477 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:18.157184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:18.158131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:18.159341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:18.159951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:18.160526 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:18.289583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:18.300640 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:18.302252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:18.303653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f9e392ca-15d8-4024-84e0-3e0e951ec319 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.217228 Aug 17 20:27:18.304390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 381/764] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:18 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:27:18.309140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-d0eac57a-01d6-4eb7-b94f-b4c33065a09d req-22ca1da4-8aca-4946-8123-dbd7bcb3ae09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bea3f1a-de51-4e44-a6f1-10c4bf2914b7", "tag": "5ade2021-1c6b-4b2f-9c25-f2f22b18ac41"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:18.318956 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-d0eac57a-01d6-4eb7-b94f-b4c33065a09d req-22ca1da4-8aca-4946-8123-dbd7bcb3ae09 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:18.319404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-d0eac57a-01d6-4eb7-b94f-b4c33065a09d req-22ca1da4-8aca-4946-8123-dbd7bcb3ae09 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:18.320517 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-d0eac57a-01d6-4eb7-b94f-b4c33065a09d req-22ca1da4-8aca-4946-8123-dbd7bcb3ae09 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:18.332601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-d0eac57a-01d6-4eb7-b94f-b4c33065a09d req-22ca1da4-8aca-4946-8123-dbd7bcb3ae09 service nova] Creating event network-changed:5ade2021-1c6b-4b2f-9c25-f2f22b18ac41 for instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 on hv-cinder-83538 Aug 17 20:27:18.337672 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-d0eac57a-01d6-4eb7-b94f-b4c33065a09d req-22ca1da4-8aca-4946-8123-dbd7bcb3ae09 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031931 Aug 17 20:27:18.338349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 382/765] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:18.388404 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:18.417375 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e7e4c1df-8abd-4c73-9372-bd80b3aac8c4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.272131 Aug 17 20:27:18.431073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 384/766] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:18 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:19.331913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:19.332529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:19.339556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:19.340053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:19.340680 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:19.341389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:19.341854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:19.342286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:19.444963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:19.446236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:19.457694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:19.458529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:19.463451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:19.464280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:19.464937 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:19.465379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:19.572725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:19.587259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:19.587259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:19.588832 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-446c54c6-72f3-431e-b071-f55fe8ecfb6c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.262862 Aug 17 20:27:19.596115 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 383/767] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:19 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:19.665694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:19.674999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-561c3a15-ab24-4f6a-8fd6-a0fb873f5a10 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.239164 Aug 17 20:27:19.685104 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 385/768] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:19 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:20.612952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:20.613659 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:20.622549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:20.623515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:20.624450 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:20.625139 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:20.625857 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:20.627162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:20.707207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:20.709063 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:20.724737 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:20.726812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:20.731714 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:20.731714 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:20.731714 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:20.732773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:20.892157 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:20.908068 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:20.909980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:20.911303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-98a2781b-4887-4165-abf5-e43c030b2fed tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.302835 Aug 17 20:27:20.911880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 384/769] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:20 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:27:20.963499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:20.972221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:20.990839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-827a954f-7b5e-4e6e-a143-a479a9b7bfd9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.294632 Aug 17 20:27:21.003109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 386/770] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:20 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:21.937201 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:21.938477 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:21.945967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:21.946784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:21.947390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:21.948288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:21.948944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:21.949529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:22.017512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:22.018149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:22.031919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:22.031919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:22.031919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:22.031919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:22.033245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:22.033245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:22.179998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:22.190053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:22.195710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:22.195710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0ef08729-f337-46e0-b878-d9428d7ce5eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.260339 Aug 17 20:27:22.195710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 385/771] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:21 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:22.253158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:22.261056 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ad28d4b2-73c1-48c0-8cd6-27e370a27383 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.248810 Aug 17 20:27:22.261957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 387/772] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:22 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:23.217477 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:23.218889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:23.226203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:23.226760 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:23.227208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:23.227929 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:23.228582 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:23.229014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:23.290229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:23.292728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:23.301684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:23.303348 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:23.305216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:23.306977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:23.308340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:23.308841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:23.466243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:23.486416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:23.553506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:23.558032 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:23.561295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:23.563394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:23.565094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-718361a0-aa35-4a81-9729-b972e3f8517c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.351711 Aug 17 20:27:23.566081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dbed25f9-9ea0-4ebb-9ab0-b4bb35a40b3e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.285170 Aug 17 20:27:23.568328 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 388/773] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:23 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:23.570820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 386/774] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:23 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:24.589676 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:24.590225 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:24.590818 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:24.592106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:24.602843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:24.603610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:24.604209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:24.609065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:24.609065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:24.609065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:24.621449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=6 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:24.627725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:24.629619 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:24.631193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:24.633583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:24.635356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:24.637166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:24.990180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:24.999272 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:25.001524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:25.003120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-714530d5-0d49-4e89-92e2-271e810accf2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.416699 Aug 17 20:27:25.003525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:25.005593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 387/775] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:24 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:27:25.012897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8e0bca4d-c4a1-46dc-b82b-a79726bb4013 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.427065 Aug 17 20:27:25.013858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 389/776] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:24 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:25.318358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-c55de052-1240-400f-a535-de02068d971e req-d30fb4cd-2063-4f98-a026-814e1cd47264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bea3f1a-de51-4e44-a6f1-10c4bf2914b7", "name": "network-vif-plugged", "status": "completed", "tag": "5ade2021-1c6b-4b2f-9c25-f2f22b18ac41"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:25.328304 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-c55de052-1240-400f-a535-de02068d971e req-d30fb4cd-2063-4f98-a026-814e1cd47264 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:25.329208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-c55de052-1240-400f-a535-de02068d971e req-d30fb4cd-2063-4f98-a026-814e1cd47264 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:25.329860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-c55de052-1240-400f-a535-de02068d971e req-d30fb4cd-2063-4f98-a026-814e1cd47264 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:25.342205 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-c55de052-1240-400f-a535-de02068d971e req-d30fb4cd-2063-4f98-a026-814e1cd47264 service nova] Creating event network-vif-plugged:5ade2021-1c6b-4b2f-9c25-f2f22b18ac41 for instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 on hv-cinder-83538 Aug 17 20:27:25.347771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-c55de052-1240-400f-a535-de02068d971e req-d30fb4cd-2063-4f98-a026-814e1cd47264 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034162 Aug 17 20:27:25.348415 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 388/777] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:26.027332 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:26.027986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:26.035610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.036098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.036530 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.036943 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:26.037620 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.037812 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:26.037956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.038236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.040400 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:26.045883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.046383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.046872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.048141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.048876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.049341 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.382338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:26.388616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:26.392864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:26.394666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:26.396089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-18db6685-c6f5-4d56-859c-a45b82d11531 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.373060 Aug 17 20:27:26.396981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 390/778] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:26 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:26.402017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:26.402949 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:26.409093 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.409596 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.410105 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.410848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.411312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.411740 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.412921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-945c6613-6ba7-4395-83dd-36e899ec0cd6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.381556 Aug 17 20:27:26.421379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 389/779] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:26 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:26.506498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'services' on Instance uuid 19fb5faa-99aa-4e6a-9d28-c82d7c47222d {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:26.750541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-00830e22-26da-404d-9f32-902a63c1f137 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "DELETE /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments/36b934c0-b3fc-4cb5-b1e0-e4eb0744eb96" status: 202 len: 0 microversion: 2.1 time: 0.352432 Aug 17 20:27:26.751575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 391/780] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:27:26 2022] DELETE /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments/36b934c0-b3fc-4cb5-b1e0-e4eb0744eb96 => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:27:26.760872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:26.762829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:26.770508 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.771069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.771510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.772312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:26.772781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:26.773416 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:26.806569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-215fc143-14fc-41b6-be58-8573d2d47b3a tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050427 Aug 17 20:27:26.810669 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 390/781] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:26 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:27.423785 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:27.425096 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:27.434847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:27.435484 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:27.436003 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:27.436912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:27.437092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:27.437560 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:27.437718 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:27.438121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:27.448278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:27.448854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:27.449310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:27.450775 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:27.451420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:27.452074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:27.768926 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:27.797453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:27.801620 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:27.810992 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2060634d-64e4-47d2-b746-5b02bcee031e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.385981 Aug 17 20:27:27.816883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 392/782] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:27 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:27.822854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:27.825534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:27.832926 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:27.833576 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:27.834179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:27.835050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:27.835617 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:27.836132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:27.868051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:27.873031 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0934974c-983f-40ae-8ed5-7e9d5266f291 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054811 Aug 17 20:27:27.874071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 393/783] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:27 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:27.883766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-affa976a-3a13-4ea3-bb18-3fa49fbb6f2f tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.441104 Aug 17 20:27:27.884485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 391/784] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:27 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:28.861323 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:28.865479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:28.885643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:28.893034 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:28.893611 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:28.894664 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:28.895543 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:28.897237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:28.898152 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:28.899080 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:28.901827 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:28.908391 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:28.908978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:28.909925 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:28.910506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:28.911047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:28.974600 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-22384502-42d5-4500-84e6-9a9abb84d737 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.092592 Aug 17 20:27:28.983184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 392/785] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:28 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:27:28.993626 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:28.995233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:29.010745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:29.012206 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:29.013253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:29.014913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:29.016403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:29.017918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:29.153095 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:29.166140 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:29.168050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:29.169393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8041a695-b989-429a-b4fc-d66e8262a262 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.316237 Aug 17 20:27:29.170254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 394/786] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:28 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:29.211674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:29.223294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-420e5471-e0c4-4b3f-a057-2594984c4f59 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.238277 Aug 17 20:27:29.223897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 393/787] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:28 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:29.990727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:29.993054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:30.000355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:30.001056 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:30.001509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:30.002216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:30.002712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:30.003283 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:30.036391 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2a442d46-3ff8-4341-9783-03be2a82fc9d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049817 Aug 17 20:27:30.036981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 395/788] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:29 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:30.194016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:30.194663 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:30.201599 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:30.202094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:30.202544 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:30.203274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:30.204286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:30.204869 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:30.246320 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:30.246969 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:30.253595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:30.254093 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:30.254534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:30.255278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:30.255744 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:30.256173 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:30.444483 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:30.455489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:30.457502 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:30.458987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-476b4dbe-9beb-4b53-b82e-2c89537b7a00 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.268928 Aug 17 20:27:30.462439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 394/789] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:30 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:30.488686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:30.496928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-86eae666-a7ce-4410-ac99-255f57db11fd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.254426 Aug 17 20:27:30.497509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 396/790] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:30 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:31.051112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:31.053743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:31.061752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:31.062569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:31.063852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:31.064683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:31.065270 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:31.065796 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:31.079865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:31.095250 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a93527ab-8dfd-4683-9ce0-477976a5a549 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050101 Aug 17 20:27:31.095808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 395/791] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:31 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:31.506268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:31.507494 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:31.515291 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:31.516781 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:31.517932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:31.519764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:31.520886 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:31.521879 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:31.525950 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:31.527403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:31.541983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:31.543291 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:31.544272 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:31.545800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:31.546797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:31.547485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:31.796770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:31.805239 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:31.806867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:31.808032 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-64956b1a-4e80-43d4-8f48-c147b06aded3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.312168 Aug 17 20:27:31.808605 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 397/792] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:31 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:31.825075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:31.834656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-74a66b49-c473-44d9-82e9-b3b1543be253 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.315168 Aug 17 20:27:31.837540 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 396/793] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:31 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:32.108156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:32.112911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:32.119931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:32.120424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:32.120865 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:32.121573 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:32.122028 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:32.122452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:32.157307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f2c7ef7c-a090-4aa7-ac39-973e5f501597 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052672 Aug 17 20:27:32.157860 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 398/794] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:32 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:32.832774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:32.833379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:32.840233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:32.840728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:32.841162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:32.841879 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:32.842339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:32.842815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:32.857707 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:32.858408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:32.865341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:32.865841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:32.866284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:32.867030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:32.868400 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:32.868400 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:33.062153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:33.069542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:33.072670 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:33.074266 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:33.075436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bbfd7b1d-130c-47ac-b3a2-c26190d6d079 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.247422 Aug 17 20:27:33.076003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 397/795] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:32 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:33.077914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7e070bb2-2178-4194-95ff-9b01eab850a6 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.224091 Aug 17 20:27:33.078669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 399/796] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:32 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:33.171090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:33.173824 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:33.179966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:33.180461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:33.180921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:33.181681 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:33.182138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:33.182567 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:33.223832 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c73526eb-9ec3-4679-85da-09824dfd392f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056806 Aug 17 20:27:33.224422 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 398/797] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:33 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:34.100059 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:34.100711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:34.104291 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:34.105408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:34.107915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:34.108416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:34.108868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:34.109595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:34.110181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:34.110656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:34.113723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:34.114447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:34.114922 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:34.119165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:34.119165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:34.119165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:34.346070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:34.355023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:34.356553 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:34.357721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-002ea7e2-ebe2-454b-91ba-3a6782181e14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.261772 Aug 17 20:27:34.358676 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 400/798] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:34 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:34.361402 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:34.363582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:34.365897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:34.369591 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-74394f9f-ac48-44a8-810f-eef9a2ada56d tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.272859 Aug 17 20:27:34.370222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 399/799] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:34 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:34.372143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:34.372637 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:34.373074 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:34.374039 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:34.374527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:34.374949 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:34.407724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-08ed6b0d-cc19-4b94-8149-37c85c60b326 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048100 Aug 17 20:27:34.408320 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 401/800] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:34 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:35.387802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:35.388446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:35.394866 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:35.395937 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:35.400221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:35.401864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:35.402469 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:35.403532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:35.404168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:35.404715 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:35.405035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:35.405524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:35.405966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:35.406863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:35.407488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:35.407915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:35.632155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:35.634772 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:35.639292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:35.640962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a0354842-4586-413f-bcd5-3403bc5d15f5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.251680 Aug 17 20:27:35.642136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 402/801] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:35 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:35.647115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:35.648554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:35.649512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:35.650042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:35.651641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3cc5a0ce-977b-4d3f-8d5e-3e208258d23c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.267660 Aug 17 20:27:35.652220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 400/802] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:35 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:35.657672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:35.657672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:35.657672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:35.658236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:35.658392 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:35.658861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:35.688863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9bfb5998-4666-46f9-814c-085e4a033476 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045466 Aug 17 20:27:35.689424 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 403/803] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:35 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:36.663394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:36.664002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:36.670551 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:36.671104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:36.671571 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:36.672276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:36.672738 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:36.673332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:36.679193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:36.680141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:36.687521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:36.688492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:36.689250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:36.690001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:36.690450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:36.690900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:36.879091 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:36.886068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:36.886737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-fa0f819a-b242-41c0-ae32-6b160257f069 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.227155 Aug 17 20:27:36.887322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 401/804] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:36 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:36.892644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:36.895030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:36.895382 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:36.896933 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:36.898284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-044bd997-eaf3-4a8d-a51e-4e2276f55246 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1405 microversion: 2.20 time: 0.223381 Aug 17 20:27:36.898884 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 404/805] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:36 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:27:36.901471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:36.902100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:36.902538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:36.903274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:36.903728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:36.904148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:37.085230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d7cc103d-eff6-4ff9-9798-fb56c2738cac tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.196868 Aug 17 20:27:37.085812 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 402/806] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:36 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 197 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:37.909946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:37.910551 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:37.917155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:37.917638 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:37.918071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:37.918785 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:37.919234 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:37.919661 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:37.921321 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:37.921941 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:37.933007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:37.933524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:37.933958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:37.934741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:37.935210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:37.935636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.141539 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:38.150762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:38.152559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:38.153843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9cb45679-208c-4880-a0d8-e31f86138dab tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1597 microversion: 2.20 time: 0.236495 Aug 17 20:27:38.162739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 403/807] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:27:37 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1597 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:27:38.163227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:38.163356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:38.163356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:38.168133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.168674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.169051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.169858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.170320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.170777 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.171136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7c583b63-ad20-401c-ba3f-c5ffd9ede81e tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.265344 Aug 17 20:27:38.171716 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 405/808] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:37 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:38.180293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:38.180293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:38.181796 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:38.188149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.188149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.188911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.189778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.190124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.190606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.215291 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5ff05976-378f-4d35-abf0-b0b94facb08e tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059292 Aug 17 20:27:38.216321 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 404/809] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:27:38 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:27:38.316100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:38.317290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:38.324363 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.325038 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.325583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.326569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.327168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.327877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.364960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:27:38.452900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-86dd4201-9c2f-4c31-aa91-b52a76d310c6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.276900 Aug 17 20:27:38.454962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 406/810] 10.222.0.64 () {60 vars in 1316 bytes} [Wed Aug 17 20:27:38 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-interface => generated 284 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 20:27:38.770227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d2d50595-b3a1-41be-981f-cd45d623590c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "DELETE /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 204 len: 0 microversion: 2.1 time: 0.460157 Aug 17 20:27:38.774407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 405/811] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:27:38 2022] DELETE /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 0 bytes in 462 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:27:38.782231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:38.783200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:38.790066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.790556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.791281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:38.792019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:38.792474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:38.793260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:39.044325 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:39.052686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-11bfbc94-3080-4010-9bec-5ece0698736f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1688 microversion: 2.1 time: 0.275465 Aug 17 20:27:39.053335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 407/812] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:38 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1688 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:39.194706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:39.195387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:39.202041 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:39.207197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:39.207197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:39.207197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:39.207197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:39.207605 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:39.466694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:39.474813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-72a31c86-6446-4e23-a08a-2b8417c782a5 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.284425 Aug 17 20:27:39.475397 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 406/813] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:39 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:39.918407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-71f4af05-8e24-423e-b921-41469da23139 req-66f7e967-e5c6-45ad-ab3c-6d62f7446ab7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a86ddd-90d5-466f-8a34-6cc8d6d30690", "name": "network-vif-unplugged", "status": "completed", "tag": "552f575e-1f5c-477e-8e14-8836c2be669b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:39.930646 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-71f4af05-8e24-423e-b921-41469da23139 req-66f7e967-e5c6-45ad-ab3c-6d62f7446ab7 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:39.931210 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-71f4af05-8e24-423e-b921-41469da23139 req-66f7e967-e5c6-45ad-ab3c-6d62f7446ab7 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:39.931653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-71f4af05-8e24-423e-b921-41469da23139 req-66f7e967-e5c6-45ad-ab3c-6d62f7446ab7 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:39.944649 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-71f4af05-8e24-423e-b921-41469da23139 req-66f7e967-e5c6-45ad-ab3c-6d62f7446ab7 service nova] Creating event network-vif-unplugged:552f575e-1f5c-477e-8e14-8836c2be669b for instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 on hv-cinder-83538 Aug 17 20:27:39.950240 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-71f4af05-8e24-423e-b921-41469da23139 req-66f7e967-e5c6-45ad-ab3c-6d62f7446ab7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035627 Aug 17 20:27:39.950920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 408/814] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:39 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:40.009853 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-402ab6b2-c8ab-4598-9e0f-fd74ee41ddaa req-aa0548eb-4abc-4ee2-9bc8-b11f1806f307 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bea3f1a-de51-4e44-a6f1-10c4bf2914b7", "tag": "5ade2021-1c6b-4b2f-9c25-f2f22b18ac41"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:40.021008 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-402ab6b2-c8ab-4598-9e0f-fd74ee41ddaa req-aa0548eb-4abc-4ee2-9bc8-b11f1806f307 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:40.021815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-402ab6b2-c8ab-4598-9e0f-fd74ee41ddaa req-aa0548eb-4abc-4ee2-9bc8-b11f1806f307 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:40.022511 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-402ab6b2-c8ab-4598-9e0f-fd74ee41ddaa req-aa0548eb-4abc-4ee2-9bc8-b11f1806f307 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:40.035242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-402ab6b2-c8ab-4598-9e0f-fd74ee41ddaa req-aa0548eb-4abc-4ee2-9bc8-b11f1806f307 service nova] Creating event network-changed:5ade2021-1c6b-4b2f-9c25-f2f22b18ac41 for instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 on hv-cinder-83538 Aug 17 20:27:40.040802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-402ab6b2-c8ab-4598-9e0f-fd74ee41ddaa req-aa0548eb-4abc-4ee2-9bc8-b11f1806f307 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035343 Aug 17 20:27:40.041882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 407/815] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:40.077570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:40.078401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:40.086041 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:40.086790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:40.087374 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:40.088361 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:40.089152 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:40.089651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:40.302699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:40.310452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-99cb8f61-bf9b-4579-8464-483986ed1926 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1688 microversion: 2.1 time: 0.238499 Aug 17 20:27:40.311061 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 409/816] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:40 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1688 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:40.501710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:40.502451 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:40.509369 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:40.509861 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:40.510297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:40.511064 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:40.511522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:40.511966 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:40.675784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:40.684492 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-14018f19-1260-415f-a303-224029475dbf tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.190723 Aug 17 20:27:40.684827 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 408/817] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:40 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:41.334050 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:41.334847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:41.342005 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:41.342506 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:41.342987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:41.343690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:41.344968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:41.345410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:41.492559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:41.501089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fc40444f-bf97-42c0-ac6d-adf5c68b4dcf tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1688 microversion: 2.1 time: 0.171847 Aug 17 20:27:41.501665 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 410/818] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:41 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1688 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:41.706108 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:41.706766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:41.713572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:41.714087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:41.714523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:41.715270 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:41.715724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:41.716142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:41.869257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:41.884676 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-edcc2bbc-ffdf-4970-8158-7a6fd40778eb tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.182302 Aug 17 20:27:41.886068 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 409/819] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:41 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:42.522411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:42.523043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:42.530363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:42.530885 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:42.531318 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:42.533124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:42.533513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:42.533999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:42.715290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:42.725049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bd58ca62-a247-4479-a34c-6c25c49ae229 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1688 microversion: 2.1 time: 0.206644 Aug 17 20:27:42.725680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 411/820] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:42 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1688 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:42.909609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:42.910230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:42.918724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:42.919226 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:42.919869 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:42.920781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:42.921245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:42.921860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:43.079666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:43.087737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4c3058ae-ecb2-4dd4-a90c-0e1547156717 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1567 microversion: 2.1 time: 0.182950 Aug 17 20:27:43.088331 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 410/821] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:42 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:43.108743 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:43.109350 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:43.116609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:43.117100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:43.117537 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:43.118243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:43.118717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:43.119170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:43.151219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121276) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 20:27:43.638645 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e2cc0bae-ca60-4e96-b7b9-b69237685f40 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "POST /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690/action" status: 202 len: 0 microversion: 2.1 time: 0.533905 Aug 17 20:27:43.639457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 412/822] 10.222.0.64 () {60 vars in 1278 bytes} [Wed Aug 17 20:27:43 2022] POST /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690/action => generated 0 bytes in 535 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:27:43.648438 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:43.649150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:43.655850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:43.656511 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:43.657102 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:43.658014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:43.658478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:43.659056 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:43.664599 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:43.759180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:43.759760 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:43.767004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:43.767439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:43.768615 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:43.769411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:43.770052 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:43.770848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:43.824137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:43.836014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7113e877-0183-43eb-ae5b-560c02fc1805 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1515 microversion: 2.1 time: 0.191346 Aug 17 20:27:43.837221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 411/823] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:43 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1515 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:43.863628 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:43.871238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a4df7368-432d-478f-8f80-e0c3f209131c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1621 microversion: 2.1 time: 0.118924 Aug 17 20:27:43.871824 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 413/824] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:43 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1621 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:44.127229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-4e7050ee-0d91-47ee-82db-ab486ccc5934 req-3c966ddf-62f4-4d52-a0b9-e174ebe54ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19fb5faa-99aa-4e6a-9d28-c82d7c47222d", "name": "network-vif-deleted", "tag": "161d7ebe-907f-42da-9379-adf417700bb6"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:44.153012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-4e7050ee-0d91-47ee-82db-ab486ccc5934 req-3c966ddf-62f4-4d52-a0b9-e174ebe54ce9 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:44.153526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-4e7050ee-0d91-47ee-82db-ab486ccc5934 req-3c966ddf-62f4-4d52-a0b9-e174ebe54ce9 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:44.155161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-4e7050ee-0d91-47ee-82db-ab486ccc5934 req-3c966ddf-62f4-4d52-a0b9-e174ebe54ce9 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:44.167837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-4e7050ee-0d91-47ee-82db-ab486ccc5934 req-3c966ddf-62f4-4d52-a0b9-e174ebe54ce9 service nova] Creating event network-vif-deleted:161d7ebe-907f-42da-9379-adf417700bb6 for instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d on hv-cinder-83538 Aug 17 20:27:44.174497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-4e7050ee-0d91-47ee-82db-ab486ccc5934 req-3c966ddf-62f4-4d52-a0b9-e174ebe54ce9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052871 Aug 17 20:27:44.175870 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 412/825] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:44.857340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:44.858563 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:44.865823 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:44.866608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:44.867236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:44.867944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:44.868559 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:44.869218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:44.896275 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:44.897915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:44.906028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:44.908192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:44.909030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:44.910242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:44.911404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:44.911999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:44.962219 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:44.962770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:44.963344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:44.963996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'fault' on Instance uuid 19fb5faa-99aa-4e6a-9d28-c82d7c47222d {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:45.038739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:45.050421 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ac328700-8f28-4170-bb16-ab7c7925be38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 200 len: 1335 microversion: 2.1 time: 0.161525 Aug 17 20:27:45.052418 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 413/826] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:44 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 1335 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:45.100571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:45.112903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ef3cc3f3-ff50-47dc-8545-c402f1c10b2a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1515 microversion: 2.1 time: 0.258861 Aug 17 20:27:45.114188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 414/827] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:44 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1515 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:46.077137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:46.077750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 19fb5faa-99aa-4e6a-9d28-c82d7c47222d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:46.085079 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:46.085579 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:46.086024 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:46.086781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:46.087248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:46.087683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:46.102513 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] HTTP exception thrown: Instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d could not be found. Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Request method failure captured: Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d HTTP/1.1 Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U3Jr6kMmDyuEpMJkIuma3ay9uir9vZ6UI1eyehWoPf6Q27Z8GCZQaywFzJAj-0OF6VyVRBvRf6gVZS8NQkxX2oXcrwXCW0ucrAENIMw3PQ3fKQGRge7pnJpRaUb6pb01_Ys7HIrcCKauhQR4FGK7TuZmSWdSLJiUac7zEyBWXWrOZ8 Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:27:46.104246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 8cacffb3524f4f8ea97946e5e4af1ac3 Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d could not be found. Aug 17 20:27:46.105944 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '19fb5faa-99aa-4e6a-9d28-c82d7c47222d'} Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d could not be found. Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:27:46.106984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d could not be found. Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d could not be found. Aug 17 20:27:46.108320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:27:46.110245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Returning 404 to user: Instance 19fb5faa-99aa-4e6a-9d28-c82d7c47222d could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:27:46.110245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bbb0b600-4ba7-4068-8097-24b975897217 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d" status: 404 len: 111 microversion: 2.1 time: 0.033027 Aug 17 20:27:46.110245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 414/828] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:46 2022] GET /compute/v2.1/servers/19fb5faa-99aa-4e6a-9d28-c82d7c47222d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:27:46.115200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-30741b18-67b9-4490-8c1d-7d29d1b4af38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '.version_select at 0x7f23e1b41d30>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:46.135549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:46.136257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:46.142884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:46.143389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:46.143837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:46.144769 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:46.145231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:46.145663 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:46.219890 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-30741b18-67b9-4490-8c1d-7d29d1b4af38 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807852595" status: 202 len: 0 microversion: 2.1 time: 0.108493 Aug 17 20:27:46.220390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 415/829] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 17 20:27:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807852595 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:27:46.298439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:46.305521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-59b761e4-6a86-4d80-8390-6e26b47a3a0c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1517 microversion: 2.1 time: 0.172957 Aug 17 20:27:46.319987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 415/830] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:46 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1517 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:47.328766 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:47.329389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:47.336680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:47.337171 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:47.337660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:47.338372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:47.338858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:47.339951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:47.507463 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:47.516951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e38c6048-7360-49d0-942c-09709f9d993c tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1517 microversion: 2.1 time: 0.192610 Aug 17 20:27:47.518043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 416/831] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:47 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:48.539434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:48.540084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:48.548843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:48.550139 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:48.550618 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:48.551771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:48.552688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:48.553420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:48.733264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:48.741834 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-24953e87-3faf-4f81-95a5-c24f14e38873 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.206439 Aug 17 20:27:48.742390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 416/832] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:48 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:49.754871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:49.756309 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:49.762444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:49.763029 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:49.763512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:49.764265 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:49.764447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:49.765019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:49.765120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:49.765433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:49.772404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:49.772871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:49.773313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:49.774010 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:49.774466 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:49.774910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:49.793938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:27:49.929874 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:49.938196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1668f664-d587-4ef8-a32a-f7445755f44b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.178014 Aug 17 20:27:49.938739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 417/833] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:49 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:27:50.321180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-719542c4-9ac2-42ac-a12a-571ec2af9d73 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 204 len: 0 microversion: 2.1 time: 0.570120 Aug 17 20:27:50.321780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 417/834] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:27:49 2022] DELETE /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:27:50.330913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:50.343981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:50.343981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:50.343981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:50.343981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:50.344630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:50.344630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:50.344630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:50.491953 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:50.504398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-35096ac3-bc6d-4715-812d-723e8670801d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1507 microversion: 2.1 time: 0.173941 Aug 17 20:27:50.504398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 418/835] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:50 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:50.965349 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:50.966592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:50.979473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:50.980324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:50.981087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:50.982334 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:50.983188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:50.983941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:51.144123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:51.146865 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:51.153317 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-21fe9722-d016-45c3-97a4-5f1d4a9045cd tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.195963 Aug 17 20:27:51.154038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 418/836] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:50 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:51.524741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:51.525442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:51.532635 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:51.533133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:51.533583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:51.534296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:51.534794 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:51.535282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:51.612158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:51.623504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-417f3f0e-46a1-46d1-8e80-f586c32988a9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1465 microversion: 2.1 time: 0.102326 Aug 17 20:27:51.638467 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 419/837] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:51 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1465 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:51.907316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-b1c097d9-a5cb-4fbd-930b-3093554a1f4d req-7eca6585-32c9-4d90-8fa4-d6c185f4a694 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c075d32a-1481-4f49-948f-89929c655ebc", "name": "network-vif-deleted", "tag": "9b0a1441-cd79-4f90-8cbf-babd2da616ff"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:51.918937 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b1c097d9-a5cb-4fbd-930b-3093554a1f4d req-7eca6585-32c9-4d90-8fa4-d6c185f4a694 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:51.919421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b1c097d9-a5cb-4fbd-930b-3093554a1f4d req-7eca6585-32c9-4d90-8fa4-d6c185f4a694 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:51.919850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b1c097d9-a5cb-4fbd-930b-3093554a1f4d req-7eca6585-32c9-4d90-8fa4-d6c185f4a694 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:51.932027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-b1c097d9-a5cb-4fbd-930b-3093554a1f4d req-7eca6585-32c9-4d90-8fa4-d6c185f4a694 service nova] Creating event network-vif-deleted:9b0a1441-cd79-4f90-8cbf-babd2da616ff for instance c075d32a-1481-4f49-948f-89929c655ebc on hv-cinder-83538 Aug 17 20:27:51.937393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-b1c097d9-a5cb-4fbd-930b-3093554a1f4d req-7eca6585-32c9-4d90-8fa4-d6c185f4a694 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034348 Aug 17 20:27:51.938016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 419/838] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:52.175748 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:52.176404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:52.183151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:52.183643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:52.184083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:52.184799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:52.185254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:52.185667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:52.343404 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:52.352230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0ee518f9-2663-4e89-9241-5a7933edbb75 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.181037 Aug 17 20:27:52.352859 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 420/839] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:52 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:52.648022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:52.648729 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:52.656014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:52.656513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:52.656952 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:52.657698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:52.670755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:52.670755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:52.698597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:52.699137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:52.699659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:52.700035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'fault' on Instance uuid c075d32a-1481-4f49-948f-89929c655ebc {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:52.744513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:52.752955 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5c1f7c1a-e662-484d-9e3e-b2a18b417758 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 200 len: 1311 microversion: 2.1 time: 0.110275 Aug 17 20:27:52.753529 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 420/840] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:52 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 1311 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:53.375579 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:53.376301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:53.384317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:53.385880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:53.385880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:53.386110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:53.386450 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:53.386935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:53.529751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:53.538528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-728ae999-c277-48ab-a0c3-d119e1d8e814 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.167101 Aug 17 20:27:53.539282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 421/841] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:53 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:53.774322 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:53.774951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: c075d32a-1481-4f49-948f-89929c655ebc] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:53.781613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:53.782129 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:53.782565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:53.783969 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:53.784438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:53.784866 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:53.799399 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] HTTP exception thrown: Instance c075d32a-1481-4f49-948f-89929c655ebc could not be found. Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Request method failure captured: Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc HTTP/1.1 Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3Jr6kMmDyuEpMJkIuma3ay9uir9vZ6UI1eyehWoPf6Q27Z8GCZQaywFzJAj-0OF6VyVRBvRf6gVZS8NQkxX2oXcrwXCW0ucrAENIMw3PQ3fKQGRge7pnJpRaUb6pb01_Ys7HIrcCKauhQR4FGK7TuZmSWdSLJiUac7zEyBWXWrOZ8 Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:27:53.801077 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 8cacffb3524f4f8ea97946e5e4af1ac3 Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance c075d32a-1481-4f49-948f-89929c655ebc could not be found. Aug 17 20:27:53.806137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': 'c075d32a-1481-4f49-948f-89929c655ebc'} Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c075d32a-1481-4f49-948f-89929c655ebc could not be found. Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:27:53.807040 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c075d32a-1481-4f49-948f-89929c655ebc could not be found. Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c075d32a-1481-4f49-948f-89929c655ebc could not be found. Aug 17 20:27:53.808418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:27:53.809742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Returning 404 to user: Instance c075d32a-1481-4f49-948f-89929c655ebc could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:27:53.809742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2663dc3f-ef1a-4be7-b250-ce92afa637c9 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc" status: 404 len: 111 microversion: 2.1 time: 0.032051 Aug 17 20:27:53.809742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 421/842] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:53 2022] GET /compute/v2.1/servers/c075d32a-1481-4f49-948f-89929c655ebc => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:27:53.813461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:53.813991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:53.821763 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:53.822464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:53.823056 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:53.823765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:53.824224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:53.824641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:53.850855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:27:54.202122 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1c5e4bc6-65fa-43f9-aa4d-6e97c9aafd40 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "DELETE /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 204 len: 0 microversion: 2.1 time: 0.393964 Aug 17 20:27:54.202747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 422/843] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:27:53 2022] DELETE /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:27:54.211881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:54.212506 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:54.219032 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:54.219525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:54.219964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:54.221358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:54.221819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:54.222417 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:54.390304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:54.398790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b2f9eeff-4519-45c0-a072-4f9789139b7f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.190752 Aug 17 20:27:54.399377 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 422/844] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:54 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:54.561187 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:54.561805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:54.569073 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:54.569559 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:54.569995 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:54.570799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:54.571291 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:54.571717 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:54.726612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:54.735251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8ebdba5e-48e7-450d-af4d-ff6b346cfa4b tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.178410 Aug 17 20:27:54.735833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 423/845] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:54 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:55.420284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:55.420947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:55.427868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:55.428392 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:55.428855 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:55.429575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:55.430038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:55.430467 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:55.573549 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:55.583565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-62950ad4-f96b-4993-a4d6-25b0a1df839c tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.166931 Aug 17 20:27:55.584534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 423/846] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:55 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:55.759653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:55.760305 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:55.766924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:55.767493 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:55.767937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:55.768782 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:55.769246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:55.769674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:55.921710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:55.930566 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-621a1be5-6f77-44b0-8365-87d79f33cd67 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.175746 Aug 17 20:27:55.931213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 424/847] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:55 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:56.605317 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:56.605927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:56.613300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:56.613784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:56.614228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:56.614923 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:56.615483 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:56.615917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:56.760220 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:56.769197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2d4f9d76-eb3c-4151-8ba2-da4766f52e8f tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.167681 Aug 17 20:27:56.770113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 424/848] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:56 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:56.962570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:56.963146 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:56.965648 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:56.971016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:56.971839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:56.972430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:56.973345 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:56.973820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:56.974385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:57.106773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:57.115495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2463ec26-9943-49f4-98dd-1569fe6ed1ce tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.156816 Aug 17 20:27:57.116079 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 425/849] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:56 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:57.790837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:57.791367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:57.798314 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:57.798906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:57.799473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:57.800197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:57.800655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:57.801088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:57.935359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:57.935907 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:57.945614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:57.946362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:57.946883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:57.954745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:57.954745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:57.954745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:57.955665 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:57.962772 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f31202d0-4069-4609-824f-9d75b66c3b1d tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1520 microversion: 2.1 time: 0.175941 Aug 17 20:27:57.963462 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 425/850] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:57 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1520 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:57.976832 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3e48995b-268c-4262-9c42-0ffc4b08bbc3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/ips" status: 200 len: 147 microversion: 2.1 time: 0.048184 Aug 17 20:27:57.977415 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 426/851] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:27:57 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/ips => generated 147 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:58.147500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:58.151287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:58.167762 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:58.168409 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:58.170176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:58.176292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:58.176292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:58.176292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:58.224426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-f99e7c21-67b4-41b2-95cb-dc34195ec150 req-c92bc383-27c6-4f04-b43c-c89048502466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "52e647f8-55ce-495b-9377-720c285dac92", "name": "network-vif-deleted", "tag": "2d62a4b7-f472-4b11-9a65-5c868716a5f3"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:58.235030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f99e7c21-67b4-41b2-95cb-dc34195ec150 req-c92bc383-27c6-4f04-b43c-c89048502466 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:58.235517 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f99e7c21-67b4-41b2-95cb-dc34195ec150 req-c92bc383-27c6-4f04-b43c-c89048502466 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:58.236137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f99e7c21-67b4-41b2-95cb-dc34195ec150 req-c92bc383-27c6-4f04-b43c-c89048502466 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:58.251001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-f99e7c21-67b4-41b2-95cb-dc34195ec150 req-c92bc383-27c6-4f04-b43c-c89048502466 service nova] Creating event network-vif-deleted:2d62a4b7-f472-4b11-9a65-5c868716a5f3 for instance 52e647f8-55ce-495b-9377-720c285dac92 on hv-cinder-83538 Aug 17 20:27:58.255118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-f99e7c21-67b4-41b2-95cb-dc34195ec150 req-c92bc383-27c6-4f04-b43c-c89048502466 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034935 Aug 17 20:27:58.255714 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 427/852] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:58.261935 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-29ca8015-15fe-4681-8b34-921386ec6b55 req-49abe524-2af0-4569-829f-1aba6dc59080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a86ddd-90d5-466f-8a34-6cc8d6d30690", "name": "network-vif-plugged", "status": "completed", "tag": "552f575e-1f5c-477e-8e14-8836c2be669b"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:58.273059 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-29ca8015-15fe-4681-8b34-921386ec6b55 req-49abe524-2af0-4569-829f-1aba6dc59080 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:58.273728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-29ca8015-15fe-4681-8b34-921386ec6b55 req-49abe524-2af0-4569-829f-1aba6dc59080 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:58.277170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-29ca8015-15fe-4681-8b34-921386ec6b55 req-49abe524-2af0-4569-829f-1aba6dc59080 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:58.277170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:27:58.287220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-29ca8015-15fe-4681-8b34-921386ec6b55 req-49abe524-2af0-4569-829f-1aba6dc59080 service nova] Creating event network-vif-plugged:552f575e-1f5c-477e-8e14-8836c2be669b for instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 on hv-cinder-83538 Aug 17 20:27:58.292706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-29ca8015-15fe-4681-8b34-921386ec6b55 req-49abe524-2af0-4569-829f-1aba6dc59080 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035455 Aug 17 20:27:58.293533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 428/853] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:27:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:27:58.330614 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:58.341627 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d19eea1e-c148-4c9a-af01-23e34bcdc037 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.208428 Aug 17 20:27:58.342965 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 426/854] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:58 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:58.985492 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:58.986180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:58.993830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:58.994318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:58.994784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:58.995483 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:58.995933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:58.996357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:59.031197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:59.031682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:59.032111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:59.032560 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'fault' on Instance uuid 52e647f8-55ce-495b-9377-720c285dac92 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:27:59.078716 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:59.087740 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-730cfe1f-7a8f-4f97-bef6-0f100176af32 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1311 microversion: 2.1 time: 0.106868 Aug 17 20:27:59.088337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 429/855] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:58 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1311 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:59.364602 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:27:59.365227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:59.371842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:59.372340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:59.372799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:59.373741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:59.374197 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:59.374646 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:59.532588 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:27:59.540754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f1fca948-93c3-4dc1-b0d2-86c870f68a31 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1573 microversion: 2.1 time: 0.180699 Aug 17 20:27:59.541386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 427/856] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:27:59 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1573 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:27:59.702327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f6106a-a347-4f7f-8ce5-21484bfc3f5b"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:27:59.704723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:27:59.710930 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:59.711449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:59.711882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:27:59.712588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:27:59.713048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:27:59.713475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:00.109689 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:00.110304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:00.117352 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:00.117850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:00.118296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:00.119122 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:00.119586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:00.120015 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:00.152927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:00.153531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:00.153975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:00.154431 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lazy-loading 'fault' on Instance uuid 52e647f8-55ce-495b-9377-720c285dac92 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:28:00.199130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8cacffb3524f4f8ea97946e5e4af1ac3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '489cb30d561c4b6591f8cf6fb74e1ee3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:00.207084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f1d81efa-57c3-487b-84f0-a73b3b45f616 tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 200 len: 1311 microversion: 2.1 time: 0.101408 Aug 17 20:28:00.207736 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 428/857] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:00 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:28:00.565363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:00.566225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:00.572961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:00.573839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:00.574379 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:00.575225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:00.575777 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:00.576327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:00.738444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:00.747248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-13bb2808-c5cb-4554-9b05-380389c41c44 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1560 microversion: 2.1 time: 0.186302 Aug 17 20:28:00.748137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 429/858] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:00 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1560 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:28:01.201193 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f359e7bb-2bfd-46c4-a5c8-2f6897352139 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.502965 Aug 17 20:28:01.201951 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 430/859] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:27:59 2022] POST /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments => generated 194 bytes in 1505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:01.244599 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:01.245547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] [instance: 52e647f8-55ce-495b-9377-720c285dac92] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:01.253925 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:01.254986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:01.255758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:01.256635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:01.257148 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:01.257854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:01.274917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] HTTP exception thrown: Instance 52e647f8-55ce-495b-9377-720c285dac92 could not be found. Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Request method failure captured: Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 HTTP/1.1 Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3Jr6kMmDyuEpMJkIuma3ay9uir9vZ6UI1eyehWoPf6Q27Z8GCZQaywFzJAj-0OF6VyVRBvRf6gVZS8NQkxX2oXcrwXCW0ucrAENIMw3PQ3fKQGRge7pnJpRaUb6pb01_Ys7HIrcCKauhQR4FGK7TuZmSWdSLJiUac7zEyBWXWrOZ8 Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:28:01.276584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_489cb30d561c4b6591f8cf6fb74e1ee3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 489cb30d561c4b6591f8cf6fb74e1ee3 Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1498005187 Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 8cacffb3524f4f8ea97946e5e4af1ac3 Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1498005187-project Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 52e647f8-55ce-495b-9377-720c285dac92 could not be found. Aug 17 20:28:01.278087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '52e647f8-55ce-495b-9377-720c285dac92'} Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 52e647f8-55ce-495b-9377-720c285dac92 could not be found. Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:28:01.279046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 52e647f8-55ce-495b-9377-720c285dac92 could not be found. Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 52e647f8-55ce-495b-9377-720c285dac92 could not be found. Aug 17 20:28:01.280718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:01.282271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] Returning 404 to user: Instance 52e647f8-55ce-495b-9377-720c285dac92 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:28:01.282271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c3c37cfc-96c4-45f4-bfdf-474dce2bd52b tempest-ServerRescueNegativeTestJSON-1498005187 tempest-ServerRescueNegativeTestJSON-1498005187-project] 10.222.0.64 "GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92" status: 404 len: 111 microversion: 2.1 time: 0.039236 Aug 17 20:28:01.282271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 430/860] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:01 2022] GET /compute/v2.1/servers/52e647f8-55ce-495b-9377-720c285dac92 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:28:08.348835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-098ec51e-421c-46c7-b0dd-290c4eceb00c tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Action: 'create', calling method: .version_select at 0x7f23e1bf7310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1513530974", "metadata": {"Type": "work"}}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:09.044733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:09.044733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:09.045662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:09.051075 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:09.051749 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:09.052204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:09.052942 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:09.053412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:09.053851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:09.095533 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-224ce1f1-bae4-4b2b-a928-182fee5204af tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061717 Aug 17 20:28:09.096208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 431/861] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:28:09 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:28:09.113020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:09.113914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:09.121914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:09.125153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:09.125153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:09.125153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:09.125153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:09.125567 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:09.160136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-15790ae3-f492-4b85-b72e-a530bfd8d665 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/c1f6106a-a347-4f7f-8ce5-21484bfc3f5b" status: 200 len: 194 microversion: 2.1 time: 0.052715 Aug 17 20:28:09.160745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 432/862] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Aug 17 20:28:09 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/c1f6106a-a347-4f7f-8ce5-21484bfc3f5b => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:28:09.374455 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-098ec51e-421c-46c7-b0dd-290c4eceb00c tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.150827 Aug 17 20:28:09.377420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 431/863] 10.222.0.64 () {60 vars in 1156 bytes} [Wed Aug 17 20:28:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1153 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 17 20:28:09.388726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-852dd3b6-ebb6-4505-8885-c8122c6e5e24 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Calling method '.version_select at 0x7f23e1bbe280>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:09.438193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-852dd3b6-ebb6-4505-8885-c8122c6e5e24 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470" status: 200 len: 353 microversion: 2.1 time: 0.053185 Aug 17 20:28:09.438864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 433/864] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:28:09 2022] GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:10.449742 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=13 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:10.455805 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b1f90c55-84b0-405c-9d5c-eed05483605c tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Calling method '.version_select at 0x7f23e1b7a310>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:10.513212 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b1f90c55-84b0-405c-9d5c-eed05483605c tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470" status: 200 len: 354 microversion: 2.1 time: 0.064508 Aug 17 20:28:10.513774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 432/865] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:28:10 2022] GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:10.527430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b1f1c83-e35c-4b34-9983-d5c985affbf2 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Calling method '.version_select at 0x7f23e420cd30>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:10.578990 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9b1f1c83-e35c-4b34-9983-d5c985affbf2 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470" status: 200 len: 354 microversion: 2.1 time: 0.056474 Aug 17 20:28:10.579650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 434/866] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:28:10 2022] GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470 => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:10.597419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-18be37a0-f647-4ca3-8f19-498b18fc82ca tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Calling method '.version_select at 0x7f23e1bf7820>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:10.896503 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-18be37a0-f647-4ca3-8f19-498b18fc82ca tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470" status: 202 len: 0 microversion: 2.1 time: 0.303495 Aug 17 20:28:10.897082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 433/867] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:28:10 2022] DELETE /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470 => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:28:10.906468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7caf39df-e4dc-4aec-8bc2-08420194bf31 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Calling method '.version_select at 0x7f23e1c79af0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:10.967004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7caf39df-e4dc-4aec-8bc2-08420194bf31 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470" status: 200 len: 353 microversion: 2.1 time: 0.065012 Aug 17 20:28:10.967670 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 435/868] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:28:10 2022] GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470 => generated 353 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:11.108580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb5e5de5-6262-4b91-bfdd-8092648e534a"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:11.111148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:11.118789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:11.119278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:11.119716 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:11.120432 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:11.120888 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:11.124830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:11.982568 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bf243bd4-4a1a-4f88-aa14-1987147a2110 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Calling method '.version_select at 0x7f23e1bbe550>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:12.014947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-bf243bd4-4a1a-4f88-aa14-1987147a2110 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] HTTP exception thrown: Volume 6970230d-e7c9-43d0-b7a3-9719b1513470 could not be found. Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bf243bd4-4a1a-4f88-aa14-1987147a2110 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Request method failure captured: Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470 HTTP/1.1 Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U9Y7vLZPh_u436nzMLJHdZsL58xViuzt33BOmv84q5pgNm7JM77KO_wZ7-FGn1bpSS7jVhUCcTx4mu8tuy23xddrv-VJrEEoiJhq-WdhV-ZotgKAQGKL-TWQWCTLC_tk0yrtdhzHyrymqWtAiGssOK8rHUpHWU8kt2kMGvm-57vPzo Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 22127d47dd564d218b2108bf053106e1 Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesGetTestJSON-767830142 Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:28:12.021279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/22127d47dd564d218b2108bf053106e1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/22127d47dd564d218b2108bf053106e1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/22127d47dd564d218b2108bf053106e1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_22127d47dd564d218b2108bf053106e1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesGetTestJSON-767830142 Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 22127d47dd564d218b2108bf053106e1 Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesGetTestJSON-767830142 Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesGetTestJSON-767830142-project Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 59fe521f5b1c45e58267bfb8ba407496 Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesGetTestJSON-767830142-project Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Volume 6970230d-e7c9-43d0-b7a3-9719b1513470 could not be found. Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '6970230d-e7c9-43d0-b7a3-9719b1513470'} Aug 17 20:28:12.023891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6970230d-e7c9-43d0-b7a3-9719b1513470 could not be found. (HTTP 404) (Request-ID: req-8c6859e3-485e-4c9b-9fea-e4c09f632291) Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:12.026621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 17 20:28:12.029268 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6970230d-e7c9-43d0-b7a3-9719b1513470 could not be found. Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 17 20:28:12.032326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6970230d-e7c9-43d0-b7a3-9719b1513470 could not be found. Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6970230d-e7c9-43d0-b7a3-9719b1513470 could not be found. Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:12.035254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bf243bd4-4a1a-4f88-aa14-1987147a2110 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] Returning 404 to user: Volume 6970230d-e7c9-43d0-b7a3-9719b1513470 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:28:12.036601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a1307eea-743c-46f0-87d8-4f14840c0a09 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "POST /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.917182 Aug 17 20:28:12.037070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bf243bd4-4a1a-4f88-aa14-1987147a2110 tempest-VolumesGetTestJSON-767830142 tempest-VolumesGetTestJSON-767830142-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470" status: 404 len: 109 microversion: 2.1 time: 0.045572 Aug 17 20:28:12.037070 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 436/869] 10.222.0.64 () {58 vars in 1245 bytes} [Wed Aug 17 20:28:11 2022] GET /compute/v2.1/os-volumes/6970230d-e7c9-43d0-b7a3-9719b1513470 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:28:12.037317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 434/870] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:28:11 2022] POST /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments => generated 194 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:16.291642 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:16.292461 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:16.300745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:16.301245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:16.302027 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:16.302694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:16.303326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:16.303908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:16.329626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-05eac496-ffb3-40b4-b748-1f1c9f60efa9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/ips" status: 200 len: 152 microversion: 2.20 time: 0.334455 Aug 17 20:28:16.330911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 437/871] 10.222.0.64 () {60 vars in 1289 bytes} [Wed Aug 17 20:28:15 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/ips => generated 152 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 17 20:28:18.663121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:18.663959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:18.671926 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:18.672717 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:18.673383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:18.675170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:18.675937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:18.676682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:18.715874 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lazy-loading 'flavor' on Instance uuid 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:28:19.364933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-71bb78f3-78ce-4a96-8e16-b0094657bf70 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/action" status: 202 len: 0 microversion: 2.20 time: 0.706221 Aug 17 20:28:19.365915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 435/872] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 17 20:28:18 2022] POST /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/action => generated 0 bytes in 708 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:28:19.375982 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:19.377699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:19.385868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:19.386616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:19.387177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:19.388058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:19.388613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:19.389125 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:19.583686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:19.597447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:19.599689 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:19.601381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-13c7d380-64ec-4cc0-a583-6f1af6e2319c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.230759 Aug 17 20:28:19.602241 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 438/873] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:19 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:20.647269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:20.648473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:20.659645 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:20.661590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:20.662136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:20.663631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:20.664437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:20.665118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:20.843523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:20.848341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:20.860448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:20.861782 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:20.862492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:20.863786 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:20.864639 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:20.865461 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:20.897491 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:20.907826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:20.911384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:20.913496 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7aa62c24-af42-4d44-b73d-c70534df3e5f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.275307 Aug 17 20:28:20.914352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 436/874] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:20 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:28:20.921817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f5869ccc-fbc8-4dd6-982e-962ea96bbcf2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.083535 Aug 17 20:28:20.922925 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 439/875] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:28:20 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments => generated 371 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:28:21.070774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:21.071356 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:21.078365 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:21.079026 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:21.079487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:21.080294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:21.080773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:21.081211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:21.120318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ed6df449-c08d-4320-a769-16e1e76584fe tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/c1f6106a-a347-4f7f-8ce5-21484bfc3f5b" status: 200 len: 194 microversion: 2.1 time: 0.053800 Aug 17 20:28:21.121114 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 437/876] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Aug 17 20:28:21 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/c1f6106a-a347-4f7f-8ce5-21484bfc3f5b => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:21.134172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:21.134699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:21.141283 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:21.141811 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:21.142211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:21.143646 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:21.144109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:21.144533 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:21.364715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lazy-loading 'services' on Instance uuid 88181da3-87e0-4a41-a592-a73bcf73cf9a {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:28:21.364715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=100 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:21.607474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-263d158c-3967-4915-8fb8-6bf1995505b8 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/c1f6106a-a347-4f7f-8ce5-21484bfc3f5b" status: 202 len: 0 microversion: 2.1 time: 0.476897 Aug 17 20:28:21.614255 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 440/877] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:28:21 2022] DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/c1f6106a-a347-4f7f-8ce5-21484bfc3f5b => generated 0 bytes in 479 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:28:21.950478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:21.951651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:21.960965 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:21.961617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:21.962192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:21.963028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:21.963653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:21.964249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:22.229777 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:22.242327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:22.244338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:22.246206 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2dd43899-97da-4df6-a584-229bb86132f2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.303043 Aug 17 20:28:22.247377 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 438/878] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:21 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:23.291790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:23.293069 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:23.308868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.309680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.310832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:23.312104 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.312950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.313728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:23.540512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:23.557597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:23.561507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:23.565616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c7d646e3-1104-4bbf-9c9a-2fd901a97dc3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.283608 Aug 17 20:28:23.569941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 441/879] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:23 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:23.853872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:23.854589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:23.861938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.862437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.868608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:23.868608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.868608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.868608 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:23.898032 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-374f0050-510f-4de5-95bc-9ae99f9ce964 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/fb5e5de5-6262-4b91-bfdd-8092648e534a" status: 200 len: 194 microversion: 2.1 time: 0.048237 Aug 17 20:28:23.902844 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 439/880] 10.222.0.64 () {58 vars in 1413 bytes} [Wed Aug 17 20:28:23 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/fb5e5de5-6262-4b91-bfdd-8092648e534a => generated 194 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:28:23.910126 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:23.910986 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:23.917771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.918257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.918838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:23.919687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:23.920336 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:23.920769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:24.031216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lazy-loading 'services' on Instance uuid 88181da3-87e0-4a41-a592-a73bcf73cf9a {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:28:24.322333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-960b5385-136f-43cf-aae1-ae95b249104f tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/fb5e5de5-6262-4b91-bfdd-8092648e534a" status: 202 len: 0 microversion: 2.1 time: 0.416219 Aug 17 20:28:24.329915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 442/881] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:28:23 2022] DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments/fb5e5de5-6262-4b91-bfdd-8092648e534a => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:28:24.595765 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:24.596911 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:24.615330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:24.615835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:24.616284 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:24.617026 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:24.617495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:24.617937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:24.768524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:24.777095 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:24.778594 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:24.779814 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-455733f4-d81c-498c-a9b2-a7026783556e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.191359 Aug 17 20:28:24.780366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 440/882] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:24 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:25.812944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:25.814752 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:25.824518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:25.825430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:25.826083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:25.827196 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:25.827815 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:25.828384 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.020449 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:26.035660 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:26.037225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:26.038459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cd0170c0-141e-4a20-aa8f-8db2e9657244 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.232100 Aug 17 20:28:26.039058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 443/883] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:25 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:26.630814 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:26.633490 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:26.640587 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.641051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.641485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.642269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.643514 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.644004 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.676271 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f359fe19-abe6-4f41-b35f-d4c0ed7bd6b5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050634 Aug 17 20:28:26.677118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 441/884] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:28:26 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:28:26.821577 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:26.823931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:26.833031 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.833539 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.833981 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.836267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.836267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.836267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.869553 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a087dea0-58d8-4fc8-8d69-0e9ac904dfc5 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052939 Aug 17 20:28:26.870145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 444/885] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:28:26 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 17 20:28:26.959740 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:26.960246 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:26.966704 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.970589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.970589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.970589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:26.970589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:26.971243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:26.997298 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:28:27.027484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:27.065231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:27.065853 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:27.072407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:27.072821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:27.073397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:27.074125 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:27.074921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:27.075352 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:27.239191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:27.249024 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:27.251334 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:27.253082 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9c500576-0183-4dd9-9541-fb09ff07cd18 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.192573 Aug 17 20:28:27.266668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 445/886] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:27 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:27.367739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0ed96653-610e-4f60-85ae-f924ce515d54 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 204 len: 0 microversion: 2.1 time: 0.411308 Aug 17 20:28:27.368487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 442/887] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:28:26 2022] DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 17 20:28:27.377149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:27.378164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:27.384964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:27.385538 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:27.385977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:27.386808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:27.387263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:27.387686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:27.578977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:27.590304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4787f5b7-89c0-401d-868f-370b406ef6a2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1676 microversion: 2.1 time: 0.217022 Aug 17 20:28:27.591010 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 446/888] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:27 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1676 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:28:28.291770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:28.292528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:28.300552 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:28.301048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:28.301487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:28.302199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:28.302679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:28.303113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:28.499790 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:28.516107 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:28.520155 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:28.521653 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-709b3fb9-89e0-4033-b224-5bbf32c7d1d0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.234843 Aug 17 20:28:28.522824 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 443/889] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:28 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:28.614656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:28.615380 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:28.622819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:28.623319 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:28.623778 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:28.624498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:28.624960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:28.625411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:28.806487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:28.815182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-077602fd-9d7a-4b90-b3c4-c7723d6d1b39 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1676 microversion: 2.1 time: 0.205661 Aug 17 20:28:28.815765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 447/890] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:28 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1676 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:29.549580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:29.550281 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:29.557645 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:29.558136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:29.558569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:29.559330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:29.559787 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:29.560216 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:29.708655 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:29.717355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:29.718982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:29.720698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-efded622-6f91-4363-9727-b405f82d44c7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.175688 Aug 17 20:28:29.721332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 444/891] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:29 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:29.837427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:29.838051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:29.848488 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:29.849390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:29.850021 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:29.851610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:29.852472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:29.853393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:30.004608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:30.015100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-00f029f2-3e4d-495d-bfad-b3e7e6f63de2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1676 microversion: 2.1 time: 0.181733 Aug 17 20:28:30.015883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 448/892] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:29 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1676 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:30.749169 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:30.750055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:30.761409 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:30.769222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:30.769222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:30.769222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:30.769222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:30.769736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:30.800587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-9e52473f-3510-4bdd-8b31-5a5f1d87a1fd req-374981ed-aab4-41ba-980d-7c020a513c88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "88181da3-87e0-4a41-a592-a73bcf73cf9a", "name": "network-vif-deleted", "tag": "581ca84c-ae44-49a9-8153-f96d1e8ef524"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:30.822803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9e52473f-3510-4bdd-8b31-5a5f1d87a1fd req-374981ed-aab4-41ba-980d-7c020a513c88 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:30.823294 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9e52473f-3510-4bdd-8b31-5a5f1d87a1fd req-374981ed-aab4-41ba-980d-7c020a513c88 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:30.823764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9e52473f-3510-4bdd-8b31-5a5f1d87a1fd req-374981ed-aab4-41ba-980d-7c020a513c88 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:30.837535 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-9e52473f-3510-4bdd-8b31-5a5f1d87a1fd req-374981ed-aab4-41ba-980d-7c020a513c88 service nova] Creating event network-vif-deleted:581ca84c-ae44-49a9-8153-f96d1e8ef524 for instance 88181da3-87e0-4a41-a592-a73bcf73cf9a on hv-cinder-83538 Aug 17 20:28:30.849925 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-9e52473f-3510-4bdd-8b31-5a5f1d87a1fd req-374981ed-aab4-41ba-980d-7c020a513c88 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055232 Aug 17 20:28:30.854045 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 449/893] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:30.988264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:30.997933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:30.999700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:31.000919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d22f421c-f851-40c5-ac69-7cb36e55fc88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.258550 Aug 17 20:28:31.002381 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 445/894] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:30 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:28:31.039410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:31.040381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:31.047983 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:31.048741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:31.049262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:31.050071 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:31.050769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:31.051263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:31.135018 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acd37d5161b247139f337ef0bf50a764', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f95e63e2fad24821953b5549e26f9dbd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:31.145968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8e19e28b-cab7-42c2-ba77-d62877a078de tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 200 len: 1323 microversion: 2.1 time: 0.110999 Aug 17 20:28:31.146694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 450/895] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:31 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 1323 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:28:32.026976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:32.027713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:32.035150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:32.035644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:32.036084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:32.036793 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:32.037244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:32.037680 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:32.168084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:32.168800 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:32.176075 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:32.176557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:32.176995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:32.177704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:32.178154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:32.178571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:32.192074 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:32.193808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] HTTP exception thrown: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Request method failure captured: Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a HTTP/1.1 Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3HvhIe9sfdpdlZhaS6xRgExRb7OKx-GYGJHf142NYvUY3M56L7e6oDx8kCfsQyQ5e6IazWBcXVfkfCwtszvUo9tKd9mf91mCUsjpmiu_LLoFfBjjavI4OjsJ0uzocVypqRYH7T_GqEtc4KZMsydhGPAVy8vdusUQl18_N4XMtBSGs Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:28:32.195735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: acd37d5161b247139f337ef0bf50a764 Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:32.197163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '88181da3-87e0-4a41-a592-a73bcf73cf9a'} Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:28:32.197935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:32.201120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:32.202238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Returning 404 to user: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:28:32.202238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-37a4e26c-8b61-4d27-8a95-decaefcc40f0 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 404 len: 111 microversion: 2.1 time: 0.034220 Aug 17 20:28:32.202238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 451/896] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:32 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:28:32.204143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:32.206622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:32.207802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-19e4332c-57c6-4624-ae16-c2b6e5bcf3da tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.185189 Aug 17 20:28:32.218817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 446/897] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:32 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:28:32.219031 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7d68734b-fbab-4f79-b84c-a39b692c35c2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '.version_select at 0x7f23e1ba14c0>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:32.314983 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7d68734b-fbab-4f79-b84c-a39b692c35c2 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385707762" status: 202 len: 0 microversion: 2.1 time: 0.107693 Aug 17 20:28:32.315537 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 452/898] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Aug 17 20:28:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1385707762 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 17 20:28:33.231971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:33.232576 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:33.240080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:33.240671 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:33.241103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:33.241801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:33.242249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:33.242712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:33.383111 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:33.392995 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:33.394732 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:33.395931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6ae4ed4e-5c2a-4df4-97fe-900fe3310984 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.168010 Aug 17 20:28:33.396516 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 447/899] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:33 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:34.435968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:34.437730 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:34.457666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:34.458566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:34.459337 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:34.460358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:34.460927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:34.461512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:34.639968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:34.651883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:34.653865 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:34.655333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e4270a37-5692-4fbb-83b5-4c91e0533373 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.235930 Aug 17 20:28:34.655917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 453/900] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:34 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:35.699583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:35.700354 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:35.708305 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:35.708794 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:35.709230 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:35.709931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:35.710478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:35.710925 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:35.825120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:35.826121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:35.834603 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:35.835115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:35.835580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:35.836415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:35.837049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:35.837788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:35.854001 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] HTTP exception thrown: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Request method failure captured: Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a HTTP/1.1 Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3HvhIe9sfdpdlZhaS6xRgExRb7OKx-GYGJHf142NYvUY3M56L7e6oDx8kCfsQyQ5e6IazWBcXVfkfCwtszvUo9tKd9mf91mCUsjpmiu_LLoFfBjjavI4OjsJ0uzocVypqRYH7T_GqEtc4KZMsydhGPAVy8vdusUQl18_N4XMtBSGs Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:28:35.856012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: acd37d5161b247139f337ef0bf50a764 Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.857581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '88181da3-87e0-4a41-a592-a73bcf73cf9a'} Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:28:35.858376 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.859594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.862351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Returning 404 to user: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:28:35.862351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ff075910-6404-4b1d-9405-d4abac979085 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 404 len: 111 microversion: 2.1 time: 0.037871 Aug 17 20:28:35.862351 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 454/901] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:28:35 2022] DELETE /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:28:35.862950 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:35.867722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:35.868341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: 88181da3-87e0-4a41-a592-a73bcf73cf9a] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:35.875194 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:35.875684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:35.876118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:35.877745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:35.877919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:35.878441 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:35.878893 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:35.880065 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:35.881292 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-82a78723-6872-4e12-ac25-c5886c9df4e9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1743 microversion: 2.20 time: 0.186048 Aug 17 20:28:35.882436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 448/902] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:35 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:35.905610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] HTTP exception thrown: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Request method failure captured: Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a HTTP/1.1 Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3HvhIe9sfdpdlZhaS6xRgExRb7OKx-GYGJHf142NYvUY3M56L7e6oDx8kCfsQyQ5e6IazWBcXVfkfCwtszvUo9tKd9mf91mCUsjpmiu_LLoFfBjjavI4OjsJ0uzocVypqRYH7T_GqEtc4KZMsydhGPAVy8vdusUQl18_N4XMtBSGs Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:28:35.908861 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: acd37d5161b247139f337ef0bf50a764 Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.914188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '88181da3-87e0-4a41-a592-a73bcf73cf9a'} Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:28:35.915060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. Aug 17 20:28:35.916452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:35.917808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Returning 404 to user: Instance 88181da3-87e0-4a41-a592-a73bcf73cf9a could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:28:35.917808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-47e7ef35-c836-4ca6-b91a-8eb6633207b3 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a" status: 404 len: 111 microversion: 2.1 time: 0.047046 Aug 17 20:28:35.917808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 455/903] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:35 2022] GET /compute/v2.1/servers/88181da3-87e0-4a41-a592-a73bcf73cf9a => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:28:36.909572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:36.913370 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:36.916731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:36.917208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:36.917636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:36.918322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:36.918871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:36.919290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:37.087667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:37.099880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:37.102024 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:37.103681 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5e3af4e4-c418-4943-80dd-76c9f196dead tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1743 microversion: 2.20 time: 0.199108 Aug 17 20:28:37.104441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 449/904] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:36 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1743 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:37.268338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:37.268987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:37.275862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:37.276687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:37.277142 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:37.277907 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:37.278431 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:37.278952 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:37.294454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] HTTP exception thrown: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Request method failure captured: Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd HTTP/1.1 Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U3HvhIe9sfdpdlZhaS6xRgExRb7OKx-GYGJHf142NYvUY3M56L7e6oDx8kCfsQyQ5e6IazWBcXVfkfCwtszvUo9tKd9mf91mCUsjpmiu_LLoFfBjjavI4OjsJ0uzocVypqRYH7T_GqEtc4KZMsydhGPAVy8vdusUQl18_N4XMtBSGs Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:28:37.296156 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: acd37d5161b247139f337ef0bf50a764 Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.299427 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': 'f848de82-5bd1-4bf9-b720-8a8fac4ea7cd'} Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:28:37.300725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.302954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.305005 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Returning 404 to user: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:28:37.305005 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9479ba3d-1aed-42be-8b15-a66e954d5b31 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 404 len: 111 microversion: 2.1 time: 0.034580 Aug 17 20:28:37.305005 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 456/905] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:28:37 2022] DELETE /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:28:37.309530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:37.310163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] [instance: f848de82-5bd1-4bf9-b720-8a8fac4ea7cd] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:37.317188 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:37.317667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:37.318158 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:37.318913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:37.319365 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:37.319783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:37.334926 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] HTTP exception thrown: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Request method failure captured: Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd HTTP/1.1 Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U3HvhIe9sfdpdlZhaS6xRgExRb7OKx-GYGJHf142NYvUY3M56L7e6oDx8kCfsQyQ5e6IazWBcXVfkfCwtszvUo9tKd9mf91mCUsjpmiu_LLoFfBjjavI4OjsJ0uzocVypqRYH7T_GqEtc4KZMsydhGPAVy8vdusUQl18_N4XMtBSGs Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:28:37.344801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f95e63e2fad24821953b5549e26f9dbd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: f95e63e2fad24821953b5549e26f9dbd Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeTestJSON-472226058 Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: acd37d5161b247139f337ef0bf50a764 Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeTestJSON-472226058-project Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.346359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': 'f848de82-5bd1-4bf9-b720-8a8fac4ea7cd'} Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:28:37.347383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. Aug 17 20:28:37.348957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:28:37.350312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] Returning 404 to user: Instance f848de82-5bd1-4bf9-b720-8a8fac4ea7cd could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:28:37.350312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-180bcb47-0ea0-47fe-a5ec-0ae249342233 tempest-AttachVolumeTestJSON-472226058 tempest-AttachVolumeTestJSON-472226058-project] 10.222.0.64 "GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd" status: 404 len: 111 microversion: 2.1 time: 0.034221 Aug 17 20:28:37.350312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 450/906] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:37 2022] GET /compute/v2.1/servers/f848de82-5bd1-4bf9-b720-8a8fac4ea7cd => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:28:38.139878 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:38.140788 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:38.147618 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:38.148106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:38.148542 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:38.149264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:38.149718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:38.150143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:38.445168 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:38.457327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:38.462959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:38.464751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-254721c0-1f4a-4d4a-bfbb-91ae1c2de5e7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.329045 Aug 17 20:28:38.466514 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 457/907] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:38 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:38.505662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-1c932647-3f21-453b-9734-3bdd555514d0 req-69c0fc52-8d1c-4b0d-8bbb-aa0f2fbd8d64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bea3f1a-de51-4e44-a6f1-10c4bf2914b7", "name": "network-vif-plugged", "status": "completed", "tag": "5ade2021-1c6b-4b2f-9c25-f2f22b18ac41"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:38.518229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-1c932647-3f21-453b-9734-3bdd555514d0 req-69c0fc52-8d1c-4b0d-8bbb-aa0f2fbd8d64 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:38.518803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-1c932647-3f21-453b-9734-3bdd555514d0 req-69c0fc52-8d1c-4b0d-8bbb-aa0f2fbd8d64 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:38.519503 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-1c932647-3f21-453b-9734-3bdd555514d0 req-69c0fc52-8d1c-4b0d-8bbb-aa0f2fbd8d64 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:38.532265 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-1c932647-3f21-453b-9734-3bdd555514d0 req-69c0fc52-8d1c-4b0d-8bbb-aa0f2fbd8d64 service nova] Creating event network-vif-plugged:5ade2021-1c6b-4b2f-9c25-f2f22b18ac41 for instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 on hv-cinder-83538 Aug 17 20:28:38.538593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-1c932647-3f21-453b-9734-3bdd555514d0 req-69c0fc52-8d1c-4b0d-8bbb-aa0f2fbd8d64 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040056 Aug 17 20:28:38.539322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 451/908] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:28:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:39.491947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:39.493524 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:39.517962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:39.519558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:39.520512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:39.521870 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:39.522835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:39.524087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:39.820389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:39.832260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:39.834035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:39.835335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9b95912e-dbb3-4986-889d-b21f293b9dcc tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.347960 Aug 17 20:28:39.851170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 458/909] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:39 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:40.868123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:40.871031 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:40.882980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:40.888861 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:40.890282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:40.891522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:40.893677 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:40.895323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:40.896460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:41.412083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:41.425452 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:41.427286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:41.428601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a503492d-4d01-47fc-bdfb-8e13d1793345 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.570471 Aug 17 20:28:41.429167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 452/910] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:40 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 572 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:42.466872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:42.468124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:42.476053 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=49,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:42.477530 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:42.478030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:42.478471 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:42.479274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:42.479811 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:42.480246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:42.753133 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:42.765555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:42.767243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:42.768583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-59f83714-91ba-4cb5-8915-d82a21a9c048 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.317339 Aug 17 20:28:42.769490 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 459/911] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:42 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:43.795181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:43.796087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:43.807092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:43.811235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:43.811235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:43.811235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:43.811912 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:43.812959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:43.994198 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:44.007288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:44.009299 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:44.010654 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b6960d65-a610-4002-b2c6-fa0c64014340 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.220329 Aug 17 20:28:44.023265 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 453/912] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:43 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:45.036284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:45.037621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:45.044608 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:45.045619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:45.046262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:45.047113 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:45.048354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:45.049250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:45.214820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:45.217176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:28:45.226219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:45.228370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:45.229751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f451c2a6-167e-43ed-bd0e-f101adbab108 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.198471 Aug 17 20:28:45.230951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 460/913] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:45 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:46.257190 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:46.257976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:46.265528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:46.265528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:46.265713 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:46.266452 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:46.267649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:46.268210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:46.442854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:46.459210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:46.464006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:46.465735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a2176e14-236a-4e18-b46e-f09154517f14 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.212590 Aug 17 20:28:46.466308 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 454/914] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:46 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:47.498159 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:47.499509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:47.508789 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:47.510431 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:47.511114 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:47.512003 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:47.512772 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:47.513360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:47.715543 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:47.727581 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:47.748066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:47.748066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8241778e-634e-4241-8007-1fe468f4fd97 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.239166 Aug 17 20:28:47.748066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 461/915] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:47 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:48.765385 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:48.766176 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:48.773735 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:48.787255 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:48.788277 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:48.789269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:48.789960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:48.790646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:48.995534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:49.007709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:49.009671 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:49.011333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5a524821-d51c-4ab3-a862-0a3ced3288c2 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.249833 Aug 17 20:28:49.012555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 455/916] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:48 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:50.038709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:50.039355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:50.046975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:50.047476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:50.047958 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:50.048672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:50.049135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:50.049564 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:50.231008 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:50.257340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:50.259770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:50.261708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-83acefa5-5ed9-4906-8a60-e3323d624b55 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.227368 Aug 17 20:28:50.262882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 462/917] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:50 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:51.292613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:51.293170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:51.303240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:51.303870 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:51.304548 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:51.305483 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:51.306290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:51.306970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:51.471440 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:51.479729 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:51.481248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:51.482444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9b0b9321-e101-4a40-85a2-64b19f5f4ee0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.195021 Aug 17 20:28:51.483023 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 456/918] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:51 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:52.508503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:52.509126 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:52.522701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:52.523210 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:52.523655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:52.524385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:52.525249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:52.525249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:52.712465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:52.725925 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:52.727508 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:52.728891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3e3493e9-bfab-4892-820c-d9f6f00325c1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.224305 Aug 17 20:28:52.729451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 463/919] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:52 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:53.765771 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:53.767151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:53.776561 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:53.777126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:53.777488 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:53.778199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:53.778667 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:53.779099 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:53.950395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:53.959678 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:53.961717 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:53.971347 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f211b4b3-2875-4b2a-bab5-da7aba2292a3 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1738 microversion: 2.20 time: 0.201821 Aug 17 20:28:53.972173 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 457/920] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:53 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1738 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:54.110938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a66d89e8-c94a-4862-8e84-7f297051d63f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: .version_select at 0x7f23e2798430>, body: {"keypair": {"name": "tempest-keypair-802589749", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFxLnMoGg/1ngau6mPzm8J2tmomN5izTieHPZwGe1mA6s5rwFc3C9NUwuRsQoVTHa525YbNXjv+OvWbu+hxdKxfoK3FI6abRSYApWESmSKoCTGJRL0ymmUM7n+UeN75z0Q=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:54.128312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-a66d89e8-c94a-4862-8e84-7f297051d63f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:28:54.132398 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-a66d89e8-c94a-4862-8e84-7f297051d63f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:28:54.265563 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a66d89e8-c94a-4862-8e84-7f297051d63f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.293431 Aug 17 20:28:54.266166 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 464/921] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:28:53 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:28:54.996126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:54.996744 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:55.004237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:55.004723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:55.005164 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:55.005875 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:55.006327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:55.007011 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:55.177917 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:55.195251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:55.197326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:55.200161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3efa4198-6358-44c3-a463-70b60a8d9465 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1720 microversion: 2.20 time: 0.207501 Aug 17 20:28:55.201295 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 458/922] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:54 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1720 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:56.242306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:56.242953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:56.260368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:56.260892 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:56.261375 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:56.267754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:56.268279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:56.268862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:56.461737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-5032a411-fcdf-4f08-a339-516b7cd48ad3 req-ce54807e-accd-48c9-a734-532f32a37212 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bea3f1a-de51-4e44-a6f1-10c4bf2914b7", "name": "network-vif-unplugged", "status": "completed", "tag": "5ade2021-1c6b-4b2f-9c25-f2f22b18ac41"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:56.473722 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-5032a411-fcdf-4f08-a339-516b7cd48ad3 req-ce54807e-accd-48c9-a734-532f32a37212 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:56.474217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-5032a411-fcdf-4f08-a339-516b7cd48ad3 req-ce54807e-accd-48c9-a734-532f32a37212 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:56.474666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-5032a411-fcdf-4f08-a339-516b7cd48ad3 req-ce54807e-accd-48c9-a734-532f32a37212 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:56.488533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-5032a411-fcdf-4f08-a339-516b7cd48ad3 req-ce54807e-accd-48c9-a734-532f32a37212 service nova] Creating event network-vif-unplugged:5ade2021-1c6b-4b2f-9c25-f2f22b18ac41 for instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 on hv-cinder-83538 Aug 17 20:28:56.494530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-5032a411-fcdf-4f08-a339-516b7cd48ad3 req-ce54807e-accd-48c9-a734-532f32a37212 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043948 Aug 17 20:28:56.495170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 459/923] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:28:56 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:28:56.536065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:56.545439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:56.547393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:56.548468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ed82ac38-659c-4b36-817c-74dba308fd9f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1720 microversion: 2.20 time: 0.314398 Aug 17 20:28:56.549032 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 465/924] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:56 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1720 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:28:57.148091 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-436595601", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31711876-3b7e-4c5a-9dfe-2ee7155c4a36"}], "security_groups": [{"name": "tempest-securitygroup--2036836877"}], "key_name": "tempest-keypair-802589749", "user_data": "}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:57.285359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] validate_networks() for [('31711876-3b7e-4c5a-9dfe-2ee7155c4a36', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:28:57.573988 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:57.574667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:57.587147 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:57.587766 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:57.591740 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:57.591740 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:57.591740 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:57.591740 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:57.824411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:57.831124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:28:57.831876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:28:57.832617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:28:57.833132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:28:57.833620 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:57.833753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:28:57.835228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:57.836414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-cd10b9b2-5255-4073-8798-a46f730a54f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1723 microversion: 2.20 time: 0.266823 Aug 17 20:28:57.837200 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 466/925] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:28:57 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:28:57.845616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:57.846278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:57.846844 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:57.847931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:57.848459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:57.849035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:57.861437 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8d4d231-d1d3-46b9-b27d-49cefa97006f"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:28:57.864506 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:57.869278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:28:57.871635 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:57.872616 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:57.873842 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:57.874945 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:28:57.875118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:57.876290 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:57.876890 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:57.887281 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:28:57.889809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:28:58.056168 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-80c3dfbb-d329-4ac3-bb5f-89fd4bf4eb34 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.913131 Aug 17 20:28:58.056826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 460/926] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:28:57 2022] POST /compute/v2.1/servers => generated 402 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 17 20:28:58.068833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0b3179c9-1dc2-4146-aab8-a261f92fb420 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:58.069810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0b3179c9-1dc2-4146-aab8-a261f92fb420 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:58.135244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0b3179c9-1dc2-4146-aab8-a261f92fb420 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:58.143575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0b3179c9-1dc2-4146-aab8-a261f92fb420 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1240 microversion: 2.1 time: 0.078558 Aug 17 20:28:58.144288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 461/927] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:58 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:28:59.164823 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0b9a2713-4714-4d13-a739-957581700e8e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:59.165460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0b9a2713-4714-4d13-a739-957581700e8e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:59.223598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0b9a2713-4714-4d13-a739-957581700e8e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:28:59.231254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0b9a2713-4714-4d13-a739-957581700e8e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1240 microversion: 2.1 time: 0.069607 Aug 17 20:28:59.231254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 462/928] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:28:59 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1240 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:28:59.295103 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e893a4ab-9ade-4d01-bdde-319d3a4810bb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.438301 Aug 17 20:28:59.295830 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 467/929] 10.222.0.64 () {62 vars in 1364 bytes} [Wed Aug 17 20:28:57 2022] POST /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-volume_attachments => generated 188 bytes in 1440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 17 20:28:59.434135 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:28:59.434711 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:28:59.443213 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:59.443701 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:59.444195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:59.444908 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:28:59.445362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:28:59.445782 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:28:59.450048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:00.253311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:00.254010 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:00.261510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:00.261999 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:00.262443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:00.263187 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:00.263647 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:00.265570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:00.308120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-723bcaa3-12c2-4a66-b7d4-b2386a8f95f7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-volume_attachments/c8d4d231-d1d3-46b9-b27d-49cefa97006f" status: 202 len: 0 microversion: 2.20 time: 0.877939 Aug 17 20:29:00.308724 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 463/930] 10.222.0.64 () {60 vars in 1457 bytes} [Wed Aug 17 20:28:59 2022] DELETE /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-volume_attachments/c8d4d231-d1d3-46b9-b27d-49cefa97006f => generated 0 bytes in 880 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:29:00.345267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:00.357832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-769e8669-4163-4e7f-affd-4aedd15cd9c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1236 microversion: 2.1 time: 0.104898 Aug 17 20:29:00.357832 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 468/931] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:00 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1236 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:29:00.382286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:00.383021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:00.389253 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:00.389736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:00.390181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:00.390913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:00.391637 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:00.392065 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:00.439315 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121275) unshelve /opt/stack/nova/nova/compute/api.py:4544}} Aug 17 20:29:00.828429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6465403a-051d-4e04-b10a-6ae64294f8b6 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "POST /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/action" status: 202 len: 0 microversion: 2.20 time: 0.450077 Aug 17 20:29:00.829637 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 464/932] 10.222.0.64 () {62 vars in 1319 bytes} [Wed Aug 17 20:29:00 2022] POST /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/action => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:29:00.838245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:00.839060 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:00.845412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:00.846191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:00.846656 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:00.847503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:00.848021 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:00.848451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:00.984967 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:00.994671 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:00.996448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:00.997896 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2fde54ad-7ae3-452a-ac09-7b41d06858f4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1671 microversion: 2.20 time: 0.163702 Aug 17 20:29:00.998457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 469/933] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:00 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:01.380696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:01.381500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:01.388070 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:01.388817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:01.389795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:01.390934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:01.392398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:01.393112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:01.479737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:01.488358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-53c59c5a-591b-4a71-a0fb-2616ed9b3c8b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1298 microversion: 2.1 time: 0.112610 Aug 17 20:29:01.489176 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 465/934] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:01 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1298 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:02.023340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:02.023964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:02.031566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:02.031566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:02.032281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:02.033016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:02.033492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:02.033921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:02.212253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:02.221833 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:02.223409 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:02.224597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1dc8425f-912a-403e-885a-b19fcffdab8e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1671 microversion: 2.20 time: 0.205689 Aug 17 20:29:02.225164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 470/935] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:02 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1671 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:02.511217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:02.512024 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:02.519843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:02.520481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:02.520991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:02.521833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:02.522567 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:02.523053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:02.682148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:02.692008 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3428e604-4fd1-4eeb-8de6-4287fafd7913 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.185165 Aug 17 20:29:02.692592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 466/936] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:02 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:03.172354 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-ce029110-49b4-4d1b-8845-f13d58f5f965 req-04041707-20e4-441a-9480-bcb9f479235b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9caaec6-d09c-42fe-a068-150f69501964", "tag": "7ca757bb-fe42-45c4-88dd-ec2ef08ad008"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:03.185460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ce029110-49b4-4d1b-8845-f13d58f5f965 req-04041707-20e4-441a-9480-bcb9f479235b service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:03.185953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ce029110-49b4-4d1b-8845-f13d58f5f965 req-04041707-20e4-441a-9480-bcb9f479235b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:03.186387 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-ce029110-49b4-4d1b-8845-f13d58f5f965 req-04041707-20e4-441a-9480-bcb9f479235b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:03.198793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-ce029110-49b4-4d1b-8845-f13d58f5f965 req-04041707-20e4-441a-9480-bcb9f479235b service nova] Creating event network-changed:7ca757bb-fe42-45c4-88dd-ec2ef08ad008 for instance c9caaec6-d09c-42fe-a068-150f69501964 on hv-cinder-83538 Aug 17 20:29:03.204119 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-ce029110-49b4-4d1b-8845-f13d58f5f965 req-04041707-20e4-441a-9480-bcb9f479235b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036558 Aug 17 20:29:03.205088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 471/937] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:29:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:03.252865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:03.253894 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:03.262853 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:03.263482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:03.264017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:03.264804 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:03.265420 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:03.266004 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:03.440367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:03.449662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:03.454242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:03.454242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-044654bb-34f5-4845-b656-27104c508e88 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.207081 Aug 17 20:29:03.454242 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 467/938] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:03 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:03.714182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:03.715115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:03.721600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:03.722086 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:03.722768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:03.723479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:03.724061 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:03.724498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:03.883813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:03.893513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ff7ef541-9b07-4ed6-816d-8a25734312c6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.183645 Aug 17 20:29:03.894176 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 472/939] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:03 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:04.477736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:04.478490 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:04.485432 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:04.485936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:04.486411 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:04.487121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:04.487582 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:04.488005 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:04.634300 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:04.643329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:04.644868 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:04.646057 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-69f9827c-d957-48a1-b007-1957479632e1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.172507 Aug 17 20:29:04.646621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 468/940] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:04 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:04.912073 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=4 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:04.916550 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:04.917192 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:04.924255 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:04.926935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:04.926935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:04.926935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:04.926935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:04.927396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:05.071937 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:05.079721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-14b291cc-aefd-4a71-9b3a-bedfe94bba1c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.168505 Aug 17 20:29:05.080307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 473/941] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:04 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:05.669799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:05.677426 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:05.688279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:05.689375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:05.691199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:05.695264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:05.695264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:05.695264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:05.882130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:05.893323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:05.894985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:05.896264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b858d4b7-af48-4317-bf8b-b257eb241ab4 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.230518 Aug 17 20:29:05.896807 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 469/942] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:05 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:06.101380 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:06.102088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:06.109169 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:06.109600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:06.110665 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:06.111704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:06.112327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:06.112987 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:06.298380 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:06.307081 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-21cebf29-376c-41e8-be64-5d61681141f1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.209476 Aug 17 20:29:06.307831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 474/943] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:06 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:29:06.929378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:06.930442 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:06.941159 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:06.942048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:06.942887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:06.943909 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:06.944424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:06.945237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:07.199088 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:07.209394 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:07.211139 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:07.212701 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-412ffeff-fa04-4a60-a2f6-810d3cec37d9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.289553 Aug 17 20:29:07.213821 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 470/944] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:06 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:07.331438 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:07.332089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:07.341882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:07.342509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:07.343043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:07.344022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:07.345129 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:07.345939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:07.567838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:07.578054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4f0113bd-ae39-4e11-98a5-8aed661f695b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.251187 Aug 17 20:29:07.580557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 475/945] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:07 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:08.242241 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:08.242964 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:08.244989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:08.252523 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:08.253379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:08.253987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:08.254967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:08.257305 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:08.257969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:08.428887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:08.452989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:08.456067 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:08.458029 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-95b19436-df81-4a75-b194-2bb81264c2a7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.220057 Aug 17 20:29:08.458666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 471/946] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:08 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:08.601613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:08.602437 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:08.609327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:08.609859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:08.610302 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:08.611066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:08.611518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:08.611976 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:08.633771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:08.712975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-546fe951-c143-4578-bd60-7721fbb18d27 req-1c7d97d7-85d4-4b70-b0b6-592601302479 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9caaec6-d09c-42fe-a068-150f69501964", "name": "network-vif-plugged", "status": "completed", "tag": "7ca757bb-fe42-45c4-88dd-ec2ef08ad008"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:08.728104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-546fe951-c143-4578-bd60-7721fbb18d27 req-1c7d97d7-85d4-4b70-b0b6-592601302479 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:08.729279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-546fe951-c143-4578-bd60-7721fbb18d27 req-1c7d97d7-85d4-4b70-b0b6-592601302479 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:08.729882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-546fe951-c143-4578-bd60-7721fbb18d27 req-1c7d97d7-85d4-4b70-b0b6-592601302479 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:08.749129 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-546fe951-c143-4578-bd60-7721fbb18d27 req-1c7d97d7-85d4-4b70-b0b6-592601302479 service nova] Creating event network-vif-plugged:7ca757bb-fe42-45c4-88dd-ec2ef08ad008 for instance c9caaec6-d09c-42fe-a068-150f69501964 on hv-cinder-83538 Aug 17 20:29:08.766903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-546fe951-c143-4578-bd60-7721fbb18d27 req-1c7d97d7-85d4-4b70-b0b6-592601302479 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057550 Aug 17 20:29:08.768159 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 472/947] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:08.820636 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:08.829252 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-254f30f7-0583-4cfb-8cd6-de6a08e0977d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.231568 Aug 17 20:29:08.836193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 476/948] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:08 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:09.486876 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:09.491232 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:09.493979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=10 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:09.504723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:09.505921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:09.507007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:09.508629 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:09.509991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:09.511550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:09.745184 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:09.765288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:09.772030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:09.774293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6e673797-ca2d-4b77-b771-0e14d58a4082 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.294041 Aug 17 20:29:09.776120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 473/949] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:09 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:09.893324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:09.895609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:09.908837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:09.909888 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:09.911189 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:09.912587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:09.913296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:09.914252 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:10.087504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:10.100875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bc9595f2-b40e-40a3-a5e0-b534a4f618cb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.225467 Aug 17 20:29:10.135099 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 477/950] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:09 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:10.801647 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:10.802268 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:10.808965 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:10.809458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:10.809898 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:10.810663 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:10.811148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:10.811575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:10.978007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:10.987049 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:10.988706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:10.993582 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8aba156f-e98f-42f6-b2ef-ad3a85837790 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.192900 Aug 17 20:29:10.994188 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 474/951] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:10 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:11.137545 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:11.138270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:11.145048 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:11.145531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:11.145960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:11.146676 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:11.147143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:11.147543 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:11.303154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:11.311821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f87660a7-6eac-4981-8480-f6acb297465d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.178041 Aug 17 20:29:11.312881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 478/952] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:11 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:12.022197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:12.023332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:12.027652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:12.036110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:12.047979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:12.047979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:12.047979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:12.047979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:12.048489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:12.213011 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:12.226917 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:12.229076 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:12.230666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c5454aa9-68c0-4077-ab94-54514dcfeec7 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.216708 Aug 17 20:29:12.231590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 475/953] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:12 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:12.335510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:12.336171 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:12.343121 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:12.368686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:12.368686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:12.368686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:12.368686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:12.369130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:12.524109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:12.533018 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9ed82c87-bef2-4b1b-b397-58df7620dac8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.201333 Aug 17 20:29:12.534115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 479/954] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:12 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:13.256849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:13.257464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:13.263906 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:13.264382 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:13.264822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:13.265562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:13.266509 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:13.266963 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:13.417504 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:13.421196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=3,nova_cell1:UPDATE=5 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:13.426570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:13.428154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:13.429358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9e82b87b-0ff7-4715-a07a-ffc77de08569 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.176686 Aug 17 20:29:13.429920 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 476/955] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:13 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:29:13.559933 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:13.561085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:13.575016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:13.576122 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:13.576932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:13.578046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:13.579809 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:13.580637 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:13.734748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:13.742122 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1bcb52fc-6703-4100-87ea-e1802eea4c6d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.189480 Aug 17 20:29:13.742735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 480/956] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:13 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:14.453267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:14.454603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:14.461714 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:14.462255 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:14.462747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:14.463447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:14.463907 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:14.464368 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:14.602868 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:14.611576 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:14.613094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:14.614282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-211e763c-ccb3-4b94-ae6f-f62d30fc0542 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.165446 Aug 17 20:29:14.614865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 477/957] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:14 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:14.764463 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:14.765076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:14.773275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:14.773275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:14.773275 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:14.773749 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:14.774207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:14.774708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:14.909990 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:14.917566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9e1b344d-e018-4be4-847e-ab173f041fb4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.157020 Aug 17 20:29:14.918131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 481/958] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:14 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:15.638875 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:15.646700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:15.646700 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:15.647237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:15.647579 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:15.648468 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:15.648890 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:15.649269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:15.787408 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:15.795853 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:15.797910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:15.799166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0d3e8a5b-f5fb-4ff1-997c-77f354d32e6b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.164463 Aug 17 20:29:15.799727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 478/959] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:15 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:15.939030 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:15.939636 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:15.942147 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:15.949278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:15.995898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:15.995898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:15.995898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:15.995898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:15.996336 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:16.094738 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:16.103110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-22192a2b-a918-489b-8882-b1b70f4debfb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1366 microversion: 2.1 time: 0.168018 Aug 17 20:29:16.103701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 482/960] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:15 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:16.823374 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:16.823969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:16.831482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:16.831977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:16.832413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:16.833128 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:16.833587 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:16.834013 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:16.984986 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:16.994522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:16.996211 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:16.997666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-233ea526-0f3a-4647-911e-673734c042b9 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.178295 Aug 17 20:29:16.998225 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 479/961] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:16 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:17.126089 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:17.126779 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:17.133956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:17.134446 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:17.135064 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:17.135791 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:17.136253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:17.136685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:17.316939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:17.327250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2c6ac16b-528a-4ccb-90a9-c00a03c561ce tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1555 microversion: 2.1 time: 0.205966 Aug 17 20:29:17.328170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 483/962] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:17 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1555 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:17.349428 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:17.350387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:17.357050 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:17.358039 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:17.358485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:17.359293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:17.360594 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:17.361129 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:17.465976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f42792a7-cc04-43a2-a61e-813221d07968 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121031 Aug 17 20:29:17.466621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 480/963] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:29:17 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-interface => generated 284 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:18.022363 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:18.023029 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:18.029307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:18.029800 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:18.039525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:18.039525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:18.039525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:18.039525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:18.185157 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:18.194556 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:18.196405 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:18.197816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2ad67679-fc36-4032-85f9-b581ae9c4e9d tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.179646 Aug 17 20:29:18.198459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 484/964] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:18 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:29:18.667959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-512ffef1-6221-4ccf-9668-718d37bbe0d1 req-a858da1b-fcf9-4bab-b43c-2ef4ad28ba11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bea3f1a-de51-4e44-a6f1-10c4bf2914b7", "name": "network-vif-plugged", "status": "completed", "tag": "5ade2021-1c6b-4b2f-9c25-f2f22b18ac41"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:18.685165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-512ffef1-6221-4ccf-9668-718d37bbe0d1 req-a858da1b-fcf9-4bab-b43c-2ef4ad28ba11 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:18.690317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-512ffef1-6221-4ccf-9668-718d37bbe0d1 req-a858da1b-fcf9-4bab-b43c-2ef4ad28ba11 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:18.690317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-512ffef1-6221-4ccf-9668-718d37bbe0d1 req-a858da1b-fcf9-4bab-b43c-2ef4ad28ba11 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:18.739622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-512ffef1-6221-4ccf-9668-718d37bbe0d1 req-a858da1b-fcf9-4bab-b43c-2ef4ad28ba11 service nova] Creating event network-vif-plugged:5ade2021-1c6b-4b2f-9c25-f2f22b18ac41 for instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 on hv-cinder-83538 Aug 17 20:29:18.739622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-512ffef1-6221-4ccf-9668-718d37bbe0d1 req-a858da1b-fcf9-4bab-b43c-2ef4ad28ba11 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045187 Aug 17 20:29:18.739622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 481/965] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:29:18.949902 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-67839989-79cd-4f83-a463-f5e3775f1eb4 req-1ec3ea5a-3638-4879-90d3-108493baea39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c9caaec6-d09c-42fe-a068-150f69501964", "tag": "7ca757bb-fe42-45c4-88dd-ec2ef08ad008"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:18.960021 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-67839989-79cd-4f83-a463-f5e3775f1eb4 req-1ec3ea5a-3638-4879-90d3-108493baea39 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:18.960504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-67839989-79cd-4f83-a463-f5e3775f1eb4 req-1ec3ea5a-3638-4879-90d3-108493baea39 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:18.960932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-67839989-79cd-4f83-a463-f5e3775f1eb4 req-1ec3ea5a-3638-4879-90d3-108493baea39 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:18.974757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-67839989-79cd-4f83-a463-f5e3775f1eb4 req-1ec3ea5a-3638-4879-90d3-108493baea39 service nova] Creating event network-changed:7ca757bb-fe42-45c4-88dd-ec2ef08ad008 for instance c9caaec6-d09c-42fe-a068-150f69501964 on hv-cinder-83538 Aug 17 20:29:18.980399 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-67839989-79cd-4f83-a463-f5e3775f1eb4 req-1ec3ea5a-3638-4879-90d3-108493baea39 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034838 Aug 17 20:29:18.981360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 485/966] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:19.223401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:19.224119 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:19.231012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:19.231812 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:19.232446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:19.233325 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:19.233930 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:19.235249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:19.400991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:19.415138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:19.419617 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:19.422721 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ed401a56-0d32-41e7-8f39-560b201df0a1 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.204363 Aug 17 20:29:19.435769 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 482/967] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:19 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:20.472593 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:20.473280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:20.479768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:20.480249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:20.480680 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:20.481368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:20.481822 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:20.482235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:20.626435 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:20.636007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:20.638196 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:20.639412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7a698463-4fea-4938-9e2a-ad6fc13603eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.172557 Aug 17 20:29:20.639968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 486/968] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:20 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:21.667811 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:21.668350 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:21.676137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:21.676763 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:21.677073 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:21.677780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:21.678297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:21.678763 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:21.823525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:21.832481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:21.833968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:21.835160 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-64ab2b90-87e6-4c47-871c-035cde9a1a63 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.171569 Aug 17 20:29:21.838326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 483/969] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:21 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:29:22.861497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:22.862283 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:22.869538 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:22.870180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:22.875856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:22.875856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:22.875856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:22.875856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:23.115552 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:23.126686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:23.129047 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:23.130784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ef1d53fc-f908-44ff-9cab-61dde522d38b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1729 microversion: 2.20 time: 0.274840 Aug 17 20:29:23.131718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 487/970] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:22 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1729 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 17 20:29:23.871777 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:23.873002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:23.882170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:23.882698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:23.883384 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:23.884327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:23.884795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:23.885447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:23.892819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-8f85bc21-eb6e-4b91-816b-08c9a91d8150 req-27fa041c-0b87-4534-90bf-377500aa5c2a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78a86ddd-90d5-466f-8a34-6cc8d6d30690", "tag": "552f575e-1f5c-477e-8e14-8836c2be669b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:23.918583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:29:23.925836 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8f85bc21-eb6e-4b91-816b-08c9a91d8150 req-27fa041c-0b87-4534-90bf-377500aa5c2a service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:23.933106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8f85bc21-eb6e-4b91-816b-08c9a91d8150 req-27fa041c-0b87-4534-90bf-377500aa5c2a service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:23.934401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8f85bc21-eb6e-4b91-816b-08c9a91d8150 req-27fa041c-0b87-4534-90bf-377500aa5c2a service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:23.954765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-8f85bc21-eb6e-4b91-816b-08c9a91d8150 req-27fa041c-0b87-4534-90bf-377500aa5c2a service nova] Creating event network-changed:552f575e-1f5c-477e-8e14-8836c2be669b for instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 on hv-cinder-83538 Aug 17 20:29:23.960797 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-8f85bc21-eb6e-4b91-816b-08c9a91d8150 req-27fa041c-0b87-4534-90bf-377500aa5c2a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090686 Aug 17 20:29:23.962517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 488/971] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:24.168277 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:24.177510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:24.188478 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:24.189206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:24.189900 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:24.191187 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:24.191916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:24.192557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:24.275454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a1bfdb75-1c71-4784-a7f4-ea3f9d3abdf9 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "DELETE /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 204 len: 0 microversion: 2.1 time: 0.407921 Aug 17 20:29:24.276359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 484/972] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:29:23 2022] DELETE /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:29:24.285912 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:24.286893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:24.294094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:24.294592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:24.295081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:24.295795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:24.296249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:24.296715 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:24.424255 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:24.439425 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:24.442014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:24.443586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-865ae75d-4048-4490-a697-06568e8bd20c tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1716 microversion: 2.20 time: 0.286433 Aug 17 20:29:24.444932 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 489/973] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:24 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1716 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:24.479113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:24.488231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-426a7e2c-3f18-4f8b-b46c-362fafab8ce4 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.207380 Aug 17 20:29:24.488825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 485/974] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:24 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:29:25.509516 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:25.510187 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:25.517644 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:25.518132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:25.518609 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:25.519372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:25.519829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:25.520253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:25.681282 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:25.694817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-397d21f3-970c-406a-8752-ede30eaac1e7 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1566 microversion: 2.1 time: 0.189096 Aug 17 20:29:25.695407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 490/975] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:25 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1566 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:26.717515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:26.719105 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:26.727245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:26.727773 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:26.728263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:26.729979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:26.730313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:26.730788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:26.893613 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:26.902971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4458d910-cf65-4794-bb63-e6dc2096953a tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1447 microversion: 2.1 time: 0.190056 Aug 17 20:29:26.916181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 486/976] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:26 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1447 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:29:27.164206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-1e20c3d3-df71-4de4-9cb1-356831e04259 req-515aad64-82df-45ae-ad19-e8dca1df0081 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78a86ddd-90d5-466f-8a34-6cc8d6d30690", "name": "network-vif-deleted", "tag": "552f575e-1f5c-477e-8e14-8836c2be669b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:27.175408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1e20c3d3-df71-4de4-9cb1-356831e04259 req-515aad64-82df-45ae-ad19-e8dca1df0081 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:27.175790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1e20c3d3-df71-4de4-9cb1-356831e04259 req-515aad64-82df-45ae-ad19-e8dca1df0081 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:27.176425 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-1e20c3d3-df71-4de4-9cb1-356831e04259 req-515aad64-82df-45ae-ad19-e8dca1df0081 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:27.193409 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-1e20c3d3-df71-4de4-9cb1-356831e04259 req-515aad64-82df-45ae-ad19-e8dca1df0081 service nova] Creating event network-vif-deleted:552f575e-1f5c-477e-8e14-8836c2be669b for instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 on hv-cinder-83538 Aug 17 20:29:27.198547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-1e20c3d3-df71-4de4-9cb1-356831e04259 req-515aad64-82df-45ae-ad19-e8dca1df0081 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038115 Aug 17 20:29:27.199240 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 491/977] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:27.927939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:27.928512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:27.935499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:27.935956 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:27.936401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:27.937107 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:27.937562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:27.938047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:28.008290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfa791db71dd4345ba4b5988a33ec533', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1291a3f047aa40278c9d3d048abc194e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:28.017864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-27e749b5-b9fb-4dae-a101-53c5c0b28072 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 200 len: 1219 microversion: 2.1 time: 0.093840 Aug 17 20:29:28.018450 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 487/978] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:27 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:29:29.040610 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:29.041625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [instance: 78a86ddd-90d5-466f-8a34-6cc8d6d30690] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:29.050186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:29.050705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:29.051254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:29.051852 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:29.052344 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:29.052768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:29.067814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] HTTP exception thrown: Instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 could not be found. Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Request method failure captured: Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 HTTP/1.1 Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U4hDd243LOYPofh5jcmsEgCTx8SaRa6acXG_rHCte_G8ESq3c_4Ehno6lRLUGvHtjQvPpNlKZZr6Uk4xkC6fbsKP279AeGg0GlyziaGq_-Emab5KGwyZgKjKZUaQ8KjfgKmp_f0BYGOb_2M92kc-r4NcGzOoy9pLpCArfQro9Hkpog Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 1291a3f047aa40278c9d3d048abc194e Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-TestShelveInstance-170131217 Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:29:29.069393 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/1291a3f047aa40278c9d3d048abc194e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1291a3f047aa40278c9d3d048abc194e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/1291a3f047aa40278c9d3d048abc194e"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_1291a3f047aa40278c9d3d048abc194e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-TestShelveInstance-170131217 Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 1291a3f047aa40278c9d3d048abc194e Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-TestShelveInstance-170131217 Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-TestShelveInstance-170131217-project Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: cfa791db71dd4345ba4b5988a33ec533 Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-TestShelveInstance-170131217-project Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 could not be found. Aug 17 20:29:29.071263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '78a86ddd-90d5-466f-8a34-6cc8d6d30690'} Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 could not be found. Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:29:29.072414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 could not be found. Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 could not be found. Aug 17 20:29:29.074034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:29:29.075554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Returning 404 to user: Instance 78a86ddd-90d5-466f-8a34-6cc8d6d30690 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:29:29.075554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-fbbc2d52-f47a-40fe-b24b-f46c43cd3d54 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690" status: 404 len: 111 microversion: 2.1 time: 0.035349 Aug 17 20:29:29.075554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 492/979] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:29:29 2022] GET /compute/v2.1/servers/78a86ddd-90d5-466f-8a34-6cc8d6d30690 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:29:29.345762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-25ff45ac-24c0-41ca-8d97-54caa0dcd754 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] Calling method '.version_select at 0x7f23e1c65b80>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:29.351527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR oslo.messaging._drivers.impl_rabbit [None req-25ff45ac-24c0-41ca-8d97-54caa0dcd754 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [dc02823d-c4e6-4d72-a99b-ebbf5c5f555e] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:29:30.359774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [None req-25ff45ac-24c0-41ca-8d97-54caa0dcd754 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] [dc02823d-c4e6-4d72-a99b-ebbf5c5f555e] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 49774. Aug 17 20:29:30.439163 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-25ff45ac-24c0-41ca-8d97-54caa0dcd754 tempest-TestShelveInstance-170131217 tempest-TestShelveInstance-170131217-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-546023720" status: 202 len: 0 microversion: 2.1 time: 1.099087 Aug 17 20:29:30.439762 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 488/980] 10.222.0.64 () {58 vars in 1251 bytes} [Wed Aug 17 20:29:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-546023720 => generated 0 bytes in 1101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:29:55.207460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:55.208390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:55.210429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=21 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:55.218228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=83 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:55.226120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:55.226622 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:55.227111 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:55.228726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:55.229383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:55.229857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:55.301416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0ce12f4f-47ac-4ea3-98df-85f7477b9d39 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/ips" status: 200 len: 149 microversion: 2.1 time: 0.097678 Aug 17 20:29:55.303362 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 493/981] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:29:55 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/ips => generated 149 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:56.679925 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:56.680780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:29:56.908263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7bc7a4ec-a907-43c3-849b-7b701faa4ea7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Action: 'create', calling method: .version_select at 0x7f23e1dd75e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-256203961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCwLrbejkX5LEc5yWhkq8GIDAd7+vx3WMpdvyiVc1VTnORZ18J9qLu1R6KQomkd9UmWpaWxM4lvsoHv+Koya2Esae59cTjQMTaDBpyG3kaB3Oex+G0lwZowQsHQnB7SWkg=="}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:56.925470 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-7bc7a4ec-a907-43c3-849b-7b701faa4ea7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for project 62ed5118006d48e8a68f1f4506e54546. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:29:56.933388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-7bc7a4ec-a907-43c3-849b-7b701faa4ea7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for user 79b37b77e3e44797b58ef9dd89747ca4 and project 62ed5118006d48e8a68f1f4506e54546. Resources: {'key_pairs'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:29:57.099121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7bc7a4ec-a907-43c3-849b-7b701faa4ea7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.420429 Aug 17 20:29:57.099729 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 489/982] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:29:56 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:29:57.362020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929f72f9-a920-45c5-9226-35b7d72f2cce"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:29:57.364515 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:57.372522 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:57.373007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:57.373682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:57.375096 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:57.376075 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:57.376668 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:57.435268 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:57.438122 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:57.452287 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:57.457630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:57.457630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:57.457630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:57.457630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:57.458196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:57.486867 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e7f509c5-5b89-4f2a-a147-57f33c8c313a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057185 Aug 17 20:29:57.487590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 490/983] 10.222.0.64 () {60 vars in 1343 bytes} [Wed Aug 17 20:29:57 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:29:57.574615 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:57.575276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:57.582922 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:57.583461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:57.583973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:57.584903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:57.585687 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:57.586357 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:57.619267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:29:58.001960 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-fcf07365-6d48-429c-9de6-0aecf1eb4fc0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 204 len: 0 microversion: 2.20 time: 0.431092 Aug 17 20:29:58.003337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 491/984] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 17 20:29:57 2022] DELETE /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:29:58.012839 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:58.013706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:58.020847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:58.021431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:58.021943 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:58.022757 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:58.023294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:58.023799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:58.191261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:58.199864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:58.201437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:58.203286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1ad4e6ba-b048-4a6e-807e-c3dc0a9767eb tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.194583 Aug 17 20:29:58.204021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 492/985] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:58 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:29:58.558833 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-08fe093e-0331-4020-b696-3efb3451ed57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.201013 Aug 17 20:29:58.559429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 494/986] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:29:57 2022] POST /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments => generated 194 bytes in 1203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:29:59.229402 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:29:59.230009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:29:59.237867 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:59.238353 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:59.238826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:59.239529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:29:59.239981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:29:59.240401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:29:59.411784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:59.422538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:59.424383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:29:59.425803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-b67ed990-1cdf-49c7-bc28-8b1052223473 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.200231 Aug 17 20:29:59.426916 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 493/987] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:29:59 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:30:00.451920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:00.453479 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:00.460577 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:00.461345 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:00.462187 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:00.463170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:00.463815 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:00.464408 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:00.627064 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:00.652253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:00.653777 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:00.655058 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6c9fa03c-a921-4581-b92c-2ec81f1203be tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1722 microversion: 2.20 time: 0.209127 Aug 17 20:30:00.655805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 495/988] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:30:00 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:30:01.196192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-f122404d-55c7-4efb-8d9a-6f17bd23047a req-0bebc56f-c321-420b-b4f0-3e09487fb95a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bea3f1a-de51-4e44-a6f1-10c4bf2914b7", "name": "network-vif-deleted", "tag": "5ade2021-1c6b-4b2f-9c25-f2f22b18ac41"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:01.210742 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f122404d-55c7-4efb-8d9a-6f17bd23047a req-0bebc56f-c321-420b-b4f0-3e09487fb95a service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:01.211398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f122404d-55c7-4efb-8d9a-6f17bd23047a req-0bebc56f-c321-420b-b4f0-3e09487fb95a service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:01.212191 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f122404d-55c7-4efb-8d9a-6f17bd23047a req-0bebc56f-c321-420b-b4f0-3e09487fb95a service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:01.228759 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-f122404d-55c7-4efb-8d9a-6f17bd23047a req-0bebc56f-c321-420b-b4f0-3e09487fb95a service nova] Creating event network-vif-deleted:5ade2021-1c6b-4b2f-9c25-f2f22b18ac41 for instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 on hv-cinder-83538 Aug 17 20:30:01.235758 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-f122404d-55c7-4efb-8d9a-6f17bd23047a req-0bebc56f-c321-420b-b4f0-3e09487fb95a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043023 Aug 17 20:30:01.236235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 494/989] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:01.684411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:01.685399 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:01.698858 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:01.699901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:01.700872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:01.703416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:01.704287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:01.705108 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:01.795038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:01.797784 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:01.799317 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:01.808519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lazy-loading 'fault' on Instance uuid 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:30:01.911918 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:01.934022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:01.937847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:01.941769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6d3085e8-6e9a-463d-919d-a0af0c43129a tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1370 microversion: 2.20 time: 0.261195 Aug 17 20:30:01.957921 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 496/990] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:30:01 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1370 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:30:02.982745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:02.991380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:02.995085 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:02.996120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:02.996921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:02.998132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:02.998917 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:02.999734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:03.044019 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:03.045134 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:03.045579 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:03.046498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lazy-loading 'fault' on Instance uuid 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:30:03.104296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:03.115267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:03.116733 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3355014e725048949595575341c69c9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7052604e37f4405bb5ccf8ffff694369', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:03.117980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0df8aa9a-59d4-4d71-96c6-8b0c2883e15f tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 200 len: 1370 microversion: 2.20 time: 0.144444 Aug 17 20:30:03.118538 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 495/991] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:30:02 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 17 20:30:04.142174 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:04.142864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:04.150819 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:04.151447 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:04.151899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:04.152621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:04.153091 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:04.153522 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:04.170396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] HTTP exception thrown: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Request method failure captured: Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 HTTP/1.1 Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U4w2cPQyeVVR5zJbaM6sXGIdE9wPe0QxiU2OcPsJfWjB7-d2J7So_JMedzfkGV9pQWR8aExntsA1l-C951ygWuemObc-MtZseXFGnTmnScQ0jXd_sdJAZH9sBGfnXGEhntfMuSYMcxL9KnDxNu7WhQQcv_dzEkZT4MibVHV3e358bw Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:30:04.172979 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 3355014e725048949595575341c69c9c Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:04.174621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '2bea3f1a-de51-4e44-a6f1-10c4bf2914b7'} Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:04.175517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:04.176972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:04.178298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Returning 404 to user: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:04.178298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d895e342-8a9a-4e55-9aab-f63138abf61b tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 404 len: 111 microversion: 2.20 time: 0.036729 Aug 17 20:30:04.178298 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 497/992] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:30:04 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:30:04.184058 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ad4bf30d-fbb9-4987-b615-834a5305d510 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '.version_select at 0x7f23e1dd7310>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:04.276281 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ad4bf30d-fbb9-4987-b615-834a5305d510 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90210224" status: 204 len: 0 microversion: 2.20 time: 0.096009 Aug 17 20:30:04.276780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 496/993] 10.222.0.64 () {60 vars in 1256 bytes} [Wed Aug 17 20:30:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90210224 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 17 20:30:06.622233 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:06.622903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:06.629871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:06.630371 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:06.630854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:06.631571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:06.632206 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:06.632930 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:06.651136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] HTTP exception thrown: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Request method failure captured: Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: DELETE /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 HTTP/1.1 Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U4w2cPQyeVVR5zJbaM6sXGIdE9wPe0QxiU2OcPsJfWjB7-d2J7So_JMedzfkGV9pQWR8aExntsA1l-C951ygWuemObc-MtZseXFGnTmnScQ0jXd_sdJAZH9sBGfnXGEhntfMuSYMcxL9KnDxNu7WhQQcv_dzEkZT4MibVHV3e358bw Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:30:06.652734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 3355014e725048949595575341c69c9c Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.656098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '2bea3f1a-de51-4e44-a6f1-10c4bf2914b7'} Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:06.657594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.660875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.664717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Returning 404 to user: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:06.664717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-86acd571-0f04-41e3-8366-f4811e0d94fe tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 404 len: 111 microversion: 2.20 time: 0.037702 Aug 17 20:30:06.664717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 498/994] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 17 20:30:06 2022] DELETE /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:30:06.669195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:06.670285 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:06.685769 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:06.686714 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:06.688827 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:06.689580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:06.690120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:06.690605 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:06.709803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] HTTP exception thrown: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Request method failure captured: Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 HTTP/1.1 Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U4w2cPQyeVVR5zJbaM6sXGIdE9wPe0QxiU2OcPsJfWjB7-d2J7So_JMedzfkGV9pQWR8aExntsA1l-C951ygWuemObc-MtZseXFGnTmnScQ0jXd_sdJAZH9sBGfnXGEhntfMuSYMcxL9KnDxNu7WhQQcv_dzEkZT4MibVHV3e358bw Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:30:06.712252 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 3355014e725048949595575341c69c9c Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.713825 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '2bea3f1a-de51-4e44-a6f1-10c4bf2914b7'} Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:06.714731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. Aug 17 20:30:06.716412 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:06.717767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Returning 404 to user: Instance 2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:06.717767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8bdb43c0-bf04-4903-95f4-35212c6f08c0 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7" status: 404 len: 111 microversion: 2.20 time: 0.053140 Aug 17 20:30:06.717767 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 497/995] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:30:06 2022] GET /compute/v2.1/servers/2bea3f1a-de51-4e44-a6f1-10c4bf2914b7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:30:07.355884 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9dab5867-1f79-4d84-a44d-c410b0c8677c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: .version_select at 0x7f23e1ce65e0>, body: {"keypair": {"name": "tempest-keypair-1471026029", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK1oYhb3qDkbpWgJGUl3goUXFNEULSMs/xAqImy+vCCKvlpTtjl+/XuMEnOnkDq8yTRCpoZ1ysdL6nEckKiyLF1Cb6gMQApS7TfoBpo/GSx3fGGsQzH5STiXDOd0rRjQyA=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:07.391604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-9dab5867-1f79-4d84-a44d-c410b0c8677c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:30:07.396612 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-9dab5867-1f79-4d84-a44d-c410b0c8677c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:30:07.480023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9dab5867-1f79-4d84-a44d-c410b0c8677c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.129817 Aug 17 20:30:07.480536 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 499/996] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:30:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:08.090739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:08.093152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:08.096198 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=4 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:08.104711 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:08.106072 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:08.111668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:08.111668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:08.111668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:08.112197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:08.134114 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] HTTP exception thrown: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Request method failure captured: Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d HTTP/1.1 Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U4w2cPQyeVVR5zJbaM6sXGIdE9wPe0QxiU2OcPsJfWjB7-d2J7So_JMedzfkGV9pQWR8aExntsA1l-C951ygWuemObc-MtZseXFGnTmnScQ0jXd_sdJAZH9sBGfnXGEhntfMuSYMcxL9KnDxNu7WhQQcv_dzEkZT4MibVHV3e358bw Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:30:08.137406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 3355014e725048949595575341c69c9c Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.139042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '43150116-1ad7-4a0c-b292-98ee4307770d'} Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:08.140905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.143843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.146344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Returning 404 to user: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:08.146344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f7796a9a-e2c6-4233-ae95-9077b4473007 tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "DELETE /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 404 len: 111 microversion: 2.20 time: 0.055905 Aug 17 20:30:08.146344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 498/997] 10.222.0.64 () {60 vars in 1280 bytes} [Wed Aug 17 20:30:08 2022] DELETE /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:30:08.152490 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:08.153797 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] [instance: 43150116-1ad7-4a0c-b292-98ee4307770d] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:08.163263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:08.164141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:08.164917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:08.166406 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:08.167851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:08.167851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:08.191139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] HTTP exception thrown: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Request method failure captured: Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d HTTP/1.1 Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U4w2cPQyeVVR5zJbaM6sXGIdE9wPe0QxiU2OcPsJfWjB7-d2J7So_JMedzfkGV9pQWR8aExntsA1l-C951ygWuemObc-MtZseXFGnTmnScQ0jXd_sdJAZH9sBGfnXGEhntfMuSYMcxL9KnDxNu7WhQQcv_dzEkZT4MibVHV3e358bw Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Openstack-Nova-Api-Version: 2.20 Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:30:08.193179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_7052604e37f4405bb5ccf8ffff694369"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 7052604e37f4405bb5ccf8ffff694369 Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-501612862 Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 3355014e725048949595575341c69c9c Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeShelveTestJSON-501612862-project Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.194757 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '43150116-1ad7-4a0c-b292-98ee4307770d'} Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:30:08.195704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. Aug 17 20:30:08.197324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:30:08.198540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] Returning 404 to user: Instance 43150116-1ad7-4a0c-b292-98ee4307770d could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:30:08.198540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-32caf4e5-04a6-4dc3-992b-4110fee0f08e tempest-AttachVolumeShelveTestJSON-501612862 tempest-AttachVolumeShelveTestJSON-501612862-project] 10.222.0.64 "GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d" status: 404 len: 111 microversion: 2.20 time: 0.047721 Aug 17 20:30:08.198540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 500/998] 10.222.0.64 () {60 vars in 1277 bytes} [Wed Aug 17 20:30:08 2022] GET /compute/v2.1/servers/43150116-1ad7-4a0c-b292-98ee4307770d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Aug 17 20:30:10.857952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-680889865", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31711876-3b7e-4c5a-9dfe-2ee7155c4a36"}], "security_groups": [{"name": "tempest-securitygroup--2059700498"}], "key_name": "tempest-keypair-1471026029", "user_data": "}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:11.075721 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] validate_networks() for [('31711876-3b7e-4c5a-9dfe-2ee7155c4a36', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:30:11.599358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:30:11.604795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:30:11.605078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:30:11.605495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:30:11.606057 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:30:11.618913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:11.619457 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:11.619893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:11.620934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:11.621624 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:11.622018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:11.654880 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:30:11.664441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:30:11.716478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:30:11.722036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:30:11.904706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-10f18302-4501-4029-908f-296d06473fcb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.054476 Aug 17 20:30:11.907752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 499/999] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:30:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:30:11.927745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-91e1a90b-16e5-4fbf-b66c-7ab250a33c3d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:11.929946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-91e1a90b-16e5-4fbf-b66c-7ab250a33c3d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:12.011572 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-91e1a90b-16e5-4fbf-b66c-7ab250a33c3d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:12.036626 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-91e1a90b-16e5-4fbf-b66c-7ab250a33c3d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1241 microversion: 2.1 time: 0.112813 Aug 17 20:30:12.074917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 501/1000] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:11 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1241 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:13.074475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:13.075325 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:13.084709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:13.087209 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:13.087209 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:13.087209 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:13.088904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:13.090150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:13.318822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:13.333093 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-11f4a13f-f739-48d3-8a19-17064856b666 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1245 microversion: 2.1 time: 0.265331 Aug 17 20:30:13.334289 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 500/1001] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:13 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1245 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:14.376890 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:14.378047 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:14.387622 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:14.388174 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:14.388731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:14.389503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:14.390359 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:14.390929 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:14.472721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:14.482619 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0f1db2ec-804e-4cec-8834-fa8b69cead22 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1293 microversion: 2.1 time: 0.114054 Aug 17 20:30:14.486518 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 502/1002] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:14 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1293 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:15.536359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:15.539470 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:15.553864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:15.555076 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:15.556090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:15.557389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:15.558236 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:15.559389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:15.680620 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:15.704627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4afa8c3b-0118-4902-8314-06420ecce897 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1299 microversion: 2.1 time: 0.186093 Aug 17 20:30:15.705343 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 501/1003] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:15 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1299 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:16.725914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:16.726831 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:16.733806 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:16.734391 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:16.734956 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:16.735687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:16.736143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:16.736753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:16.897939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:16.907578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1e8b9b14-7ef6-49ed-bd32-0d19c71d001a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.185510 Aug 17 20:30:16.909465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 503/1004] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:16 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:17.049459 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-52d28c24-8a36-432c-8f81-e0d4b8ceda77 req-49c70b28-1a1f-413f-b2ff-cc440da5b78a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7994a9-636a-40a4-8034-ec4dd4c23049", "tag": "4c498d1b-19e7-419c-a45d-d68f77a7aea8"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:17.070952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-52d28c24-8a36-432c-8f81-e0d4b8ceda77 req-49c70b28-1a1f-413f-b2ff-cc440da5b78a service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:17.072094 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-52d28c24-8a36-432c-8f81-e0d4b8ceda77 req-49c70b28-1a1f-413f-b2ff-cc440da5b78a service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:17.072485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-52d28c24-8a36-432c-8f81-e0d4b8ceda77 req-49c70b28-1a1f-413f-b2ff-cc440da5b78a service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:17.086342 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-52d28c24-8a36-432c-8f81-e0d4b8ceda77 req-49c70b28-1a1f-413f-b2ff-cc440da5b78a service nova] Creating event network-changed:4c498d1b-19e7-419c-a45d-d68f77a7aea8 for instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 on hv-cinder-83538 Aug 17 20:30:17.091516 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-52d28c24-8a36-432c-8f81-e0d4b8ceda77 req-49c70b28-1a1f-413f-b2ff-cc440da5b78a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047554 Aug 17 20:30:17.092441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 502/1005] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:17.931650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:17.932359 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:17.942175 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:17.954259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:17.956333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:17.961260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:17.963750 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:17.964894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:18.142938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:18.155170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-24b1f480-5797-43f2-b8f4-67cc0acf0185 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.228656 Aug 17 20:30:18.156139 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 504/1006] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:17 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:19.177957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:19.179368 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:19.186040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:19.186509 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:19.186963 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:19.187824 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:19.188510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:19.188936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:19.335060 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:19.342878 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ffd28522-fe5c-41e6-a88c-405d1272e8df tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.169146 Aug 17 20:30:19.343553 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 503/1007] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:19 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:19.820371 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-487713558", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-256203961", "security_groups": [{"name": "tempest-secgroup-smoke-603856003"}], "block_device_mapping_v2": [{"uuid": "29a09d63-16c3-44c6-baf2-c5bff519ed4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a7b1ac9-3bf8-4b4f-bdc4-cfae427c64c1"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:19.941655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] validate_networks() for [('8a7b1ac9-3bf8-4b4f-bdc4-cfae427c64c1', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:30:20.344850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:30:20.345314 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:30:20.345856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:30:20.346306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:30:20.346768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:30:20.355904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:20.356390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:20.356864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:20.357633 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:20.358130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:20.358561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:20.365475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:20.366723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:20.373586 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:20.374078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:20.374522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:20.375749 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:20.376143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:20.376573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:20.377136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for project 62ed5118006d48e8a68f1f4506e54546. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:30:20.381306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for user 79b37b77e3e44797b58ef9dd89747ca4 and project 62ed5118006d48e8a68f1f4506e54546. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:30:20.447966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:30:20.448719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29a09d63-16c3-44c6-baf2-c5bff519ed4b',volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:30:20.527633 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:20.534458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cab88c1b-31c5-4a17-a0fd-5d8f76012d09 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.172890 Aug 17 20:30:20.535068 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 504/1008] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:20 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:21.041711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1dd6218a-f4d5-4fb6-ae3e-dbef0fca7c7d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.225291 Aug 17 20:30:21.042666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 505/1009] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:30:19 2022] POST /compute/v2.1/servers => generated 405 bytes in 1227 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:30:21.054421 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-42ff6dea-5755-462c-92c5-67313a48edb8 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:21.055078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-42ff6dea-5755-462c-92c5-67313a48edb8 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:21.116550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-42ff6dea-5755-462c-92c5-67313a48edb8 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:21.124530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-42ff6dea-5755-462c-92c5-67313a48edb8 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1093 microversion: 2.1 time: 0.074021 Aug 17 20:30:21.125145 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 505/1010] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:21 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:21.558701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:21.558701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:21.564199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:21.564726 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:21.565163 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:21.565875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:21.566338 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:21.566800 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:21.722130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:21.730148 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c8823e47-6be4-4f80-8b17-8b9b22c64bab tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.177526 Aug 17 20:30:21.730760 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 506/1011] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:21 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:22.146182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8f5f0668-9caf-4f91-87d3-deef6270eccc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:22.147102 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8f5f0668-9caf-4f91-87d3-deef6270eccc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:22.149270 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:22.205913 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8f5f0668-9caf-4f91-87d3-deef6270eccc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:22.212899 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8f5f0668-9caf-4f91-87d3-deef6270eccc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1093 microversion: 2.1 time: 0.071262 Aug 17 20:30:22.213461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 506/1012] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:22 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1093 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:22.752143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:22.752771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:22.759640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:22.760135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:22.760575 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:22.761281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:22.761731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:22.762155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:22.908170 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:22.916313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-01fbb498-5d58-4b55-9718-4f7db6bb2ea3 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.168128 Aug 17 20:30:22.916961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 507/1013] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:22 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:23.234817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:23.237260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:23.244014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:23.244517 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:23.245143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:23.246120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:23.246584 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:23.247047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:23.315938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:23.325224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1c51fd30-01ac-4736-96bb-ac7afcc1836b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1143 microversion: 2.1 time: 0.094727 Aug 17 20:30:23.326197 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 507/1014] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:23 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1143 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:23.941421 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:23.942339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:23.950935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:23.951570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:23.952106 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:23.953017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:23.953839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:23.955051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:24.133590 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:24.141260 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-60d34ee8-c4d1-41bf-a3f0-439014d67a64 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.206496 Aug 17 20:30:24.142023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 508/1015] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:23 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:24.346893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:24.347526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:24.354281 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:24.354884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:24.355266 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:24.355979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:24.357481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:24.357481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:24.426646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:24.435683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-182309a2-444d-47e7-8d90-0077dd008050 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1143 microversion: 2.1 time: 0.093149 Aug 17 20:30:24.436595 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 508/1016] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:24 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1143 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:24.797681 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-cc169cd4-e677-495b-acfe-18266ee4c0bc req-4be5d1ad-6adb-4927-b6d5-c7263ecd8227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7994a9-636a-40a4-8034-ec4dd4c23049", "name": "network-vif-plugged", "status": "completed", "tag": "4c498d1b-19e7-419c-a45d-d68f77a7aea8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:24.808692 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cc169cd4-e677-495b-acfe-18266ee4c0bc req-4be5d1ad-6adb-4927-b6d5-c7263ecd8227 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:24.814863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cc169cd4-e677-495b-acfe-18266ee4c0bc req-4be5d1ad-6adb-4927-b6d5-c7263ecd8227 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:24.814863 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-cc169cd4-e677-495b-acfe-18266ee4c0bc req-4be5d1ad-6adb-4927-b6d5-c7263ecd8227 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:24.823597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-cc169cd4-e677-495b-acfe-18266ee4c0bc req-4be5d1ad-6adb-4927-b6d5-c7263ecd8227 service nova] Creating event network-vif-plugged:4c498d1b-19e7-419c-a45d-d68f77a7aea8 for instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 on hv-cinder-83538 Aug 17 20:30:24.829226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-cc169cd4-e677-495b-acfe-18266ee4c0bc req-4be5d1ad-6adb-4927-b6d5-c7263ecd8227 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042171 Aug 17 20:30:24.829878 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 509/1017] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:25.165116 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:25.165934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:25.172785 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:25.173970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:25.174421 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:25.175182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:25.175644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:25.176071 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:25.366045 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:25.374750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-24d9bd84-bd9a-417e-81af-3bf3f8e6fee5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.213628 Aug 17 20:30:25.375340 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 509/1018] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:25 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:25.458262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:25.458908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:25.465715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:25.466192 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:25.466651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:25.467347 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:25.467803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:25.468222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:25.538812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:25.547256 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bdfc2d51-830d-42a6-8bb1-7328c3914269 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1191 microversion: 2.1 time: 0.094343 Aug 17 20:30:25.547833 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 510/1019] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:25 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1191 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:26.396914 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:26.397545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:26.404482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:26.405047 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:26.405484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:26.406228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:26.406807 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:26.407235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:26.567712 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:26.572279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:26.574301 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:26.578739 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:26.580244 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4c374e84-4e70-499e-a807-8aff47e10d99 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1367 microversion: 2.1 time: 0.187158 Aug 17 20:30:26.581534 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 510/1020] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:26 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:26.589186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:26.590519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:26.593092 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:26.594382 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:26.596337 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:26.597611 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:26.712460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:26.726803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b76ba655-4084-483f-80c0-1000a2047a3b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1199 microversion: 2.1 time: 0.160673 Aug 17 20:30:26.727758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 511/1021] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:26 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1199 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:27.617889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:27.617889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:27.617889 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:27.622921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:27.623469 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:27.623974 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:27.624637 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:27.625095 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:27.625527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:27.753319 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:27.754214 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:27.761820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=4 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:27.764132 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:27.764640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:27.765090 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:27.765851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:27.766304 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:27.767331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:27.770814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:27.843485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:27.855542 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c4ff616e-21bf-440c-b8fb-3f66f3fa7f26 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1556 microversion: 2.1 time: 0.246377 Aug 17 20:30:27.856140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 511/1022] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:27 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1556 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:27.887006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:27.887006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:27.896682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:27.897314 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:27.897728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:27.903561 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:27.904263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:27.906938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:28.055838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:28.064985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-007e8281-935a-4293-b48c-355ee7268c16 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1276 microversion: 2.1 time: 0.318270 Aug 17 20:30:28.067484 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 512/1023] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:27 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1276 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:28.082378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-703a969b-3310-4013-ab81-ebb131e06fa1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.203733 Aug 17 20:30:28.083018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 512/1024] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:30:27 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049/os-interface => generated 284 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:30:28.830065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-dd3b78e1-d8ef-4a12-89a1-22eb77ca3f04 req-eca1bae4-6639-47d6-8dc4-fcb3ae49ca1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ca97cd-ad46-405d-8cfb-dc734e6523ab", "tag": "51f057c9-2061-42dd-866a-0fcf5ff88d0b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:28.843214 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dd3b78e1-d8ef-4a12-89a1-22eb77ca3f04 req-eca1bae4-6639-47d6-8dc4-fcb3ae49ca1b service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:28.843709 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dd3b78e1-d8ef-4a12-89a1-22eb77ca3f04 req-eca1bae4-6639-47d6-8dc4-fcb3ae49ca1b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:28.844152 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-dd3b78e1-d8ef-4a12-89a1-22eb77ca3f04 req-eca1bae4-6639-47d6-8dc4-fcb3ae49ca1b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:28.858604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-dd3b78e1-d8ef-4a12-89a1-22eb77ca3f04 req-eca1bae4-6639-47d6-8dc4-fcb3ae49ca1b service nova] Creating event network-changed:51f057c9-2061-42dd-866a-0fcf5ff88d0b for instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab on hv-cinder-83538 Aug 17 20:30:28.866299 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-dd3b78e1-d8ef-4a12-89a1-22eb77ca3f04 req-eca1bae4-6639-47d6-8dc4-fcb3ae49ca1b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040909 Aug 17 20:30:28.867941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 513/1025] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:29.091752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:29.093542 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:29.109063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:29.109980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:29.111610 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:29.113245 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:29.114659 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:29.115503 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:29.416207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:29.431787 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-34f9bfb3-04a2-49cd-b971-02bb16527bd5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1276 microversion: 2.1 time: 0.345271 Aug 17 20:30:29.432851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 513/1026] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:29 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1276 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:29.637547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-471c9c71-2807-44be-bb77-66dc049f6f29 req-f33fb291-6b07-4bd8-bda0-1490fe55b46b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0e7994a9-636a-40a4-8034-ec4dd4c23049", "tag": "4c498d1b-19e7-419c-a45d-d68f77a7aea8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:29.654284 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-471c9c71-2807-44be-bb77-66dc049f6f29 req-f33fb291-6b07-4bd8-bda0-1490fe55b46b service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:29.654802 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-471c9c71-2807-44be-bb77-66dc049f6f29 req-f33fb291-6b07-4bd8-bda0-1490fe55b46b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:29.655245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-471c9c71-2807-44be-bb77-66dc049f6f29 req-f33fb291-6b07-4bd8-bda0-1490fe55b46b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:29.670700 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-471c9c71-2807-44be-bb77-66dc049f6f29 req-f33fb291-6b07-4bd8-bda0-1490fe55b46b service nova] Creating event network-changed:4c498d1b-19e7-419c-a45d-d68f77a7aea8 for instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 on hv-cinder-83538 Aug 17 20:30:29.680175 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-471c9c71-2807-44be-bb77-66dc049f6f29 req-f33fb291-6b07-4bd8-bda0-1490fe55b46b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047456 Aug 17 20:30:29.681826 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 514/1027] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:30:30.457720 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:30.458842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:30.466202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:30.466725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:30.467165 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:30.467896 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:30.468550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:30.468958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:30.649318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:30.662498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e730d2ba-cd3d-47d8-bfc7-db2a01ca2d1d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.208972 Aug 17 20:30:30.662498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 514/1028] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:30 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:31.681750 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:31.682884 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=12 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:31.689500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:31.689500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:31.695723 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:31.696215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:31.696663 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:31.697385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:31.697854 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:31.698280 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:31.890205 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:31.901065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-38fbaf57-12f0-4aff-ab0c-150263af7386 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.220760 Aug 17 20:30:31.901882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 515/1029] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:31 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:32.923118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:32.923737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:32.926149 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=10 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:30:32.931001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:32.931491 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:32.931978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:32.932636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:32.933086 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:32.933513 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:33.102419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:33.112800 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-43599a07-dafa-4d1b-93e2-bf02e28c10d6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.193408 Aug 17 20:30:33.113446 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 515/1030] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:32 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:34.136198 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:34.137253 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:34.145734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:34.146270 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:34.146755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:34.149267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:34.149267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:34.149267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:34.327816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:34.344006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8c540523-7ef8-4a12-a946-560f7c0e725f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.211985 Aug 17 20:30:34.344795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 516/1031] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:34 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:35.372602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:35.374878 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:35.387068 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:35.388039 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:35.389040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:35.390393 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:35.391326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:35.393243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:35.598937 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:35.607434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-873acb7e-389e-40ba-9f45-84b34e966f52 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.242175 Aug 17 20:30:35.608212 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 516/1032] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:35 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:36.635179 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:36.636286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:36.648911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:36.649767 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:36.650499 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:36.651790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:36.652579 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:36.653320 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:36.856741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:36.868576 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-339e2cd2-a3c0-4b40-a933-bb19df09da81 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.240670 Aug 17 20:30:36.869279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 517/1033] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:36 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:37.900915 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:37.901993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:37.914282 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:37.919053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:37.919053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:37.919053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:37.919053 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:37.919434 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:38.089355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:38.101808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-84e46960-669b-4ea1-bc58-fff7f341c6f2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.204772 Aug 17 20:30:38.101808 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 517/1034] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:37 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:38.919085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-95496094-6af5-47cf-ac32-e1eed79276fa req-efadbd4c-ece0-4d7a-ad5d-7b7cbae95191 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ca97cd-ad46-405d-8cfb-dc734e6523ab", "name": "network-vif-plugged", "status": "completed", "tag": "51f057c9-2061-42dd-866a-0fcf5ff88d0b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:38.934776 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-95496094-6af5-47cf-ac32-e1eed79276fa req-efadbd4c-ece0-4d7a-ad5d-7b7cbae95191 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:38.935906 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-95496094-6af5-47cf-ac32-e1eed79276fa req-efadbd4c-ece0-4d7a-ad5d-7b7cbae95191 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:38.936688 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-95496094-6af5-47cf-ac32-e1eed79276fa req-efadbd4c-ece0-4d7a-ad5d-7b7cbae95191 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:38.963246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-95496094-6af5-47cf-ac32-e1eed79276fa req-efadbd4c-ece0-4d7a-ad5d-7b7cbae95191 service nova] Creating event network-vif-plugged:51f057c9-2061-42dd-866a-0fcf5ff88d0b for instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab on hv-cinder-83538 Aug 17 20:30:38.972782 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-95496094-6af5-47cf-ac32-e1eed79276fa req-efadbd4c-ece0-4d7a-ad5d-7b7cbae95191 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056922 Aug 17 20:30:38.973814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 518/1035] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:30:39.136366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:39.137779 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:39.145302 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:39.154171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:39.154171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:39.154171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:39.154171 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:39.155336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:39.335257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:39.356209 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-622b9ea9-d344-495c-8485-ee406bf57943 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.224207 Aug 17 20:30:39.356806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 518/1036] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:39 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:40.389742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:40.391263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:40.405335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:40.406118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:40.406926 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:40.408315 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:40.409133 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:40.409894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:40.606565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:40.616519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d2809d2e-ebb0-4dab-93b5-680c185ca721 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1264 microversion: 2.1 time: 0.238863 Aug 17 20:30:40.617316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 519/1037] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:40 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:41.654967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:41.655770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:41.665573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:41.665573 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:41.666855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:41.668030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:41.668681 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:41.669550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:41.866832 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:41.877828 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-86dadf03-1da8-4880-802a-4f611654caae tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1451 microversion: 2.1 time: 0.230952 Aug 17 20:30:41.891108 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 519/1038] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:41 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1451 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:30:41.899171 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:30:41.899993 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:30:41.909095 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:41.909790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:41.910439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:41.911344 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:41.911893 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:41.912402 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:42.106655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:30:42.116444 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1290451f-9aca-49bf-89fe-ffa1f007045f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1451 microversion: 2.1 time: 0.221332 Aug 17 20:30:42.117184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 520/1039] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:30:41 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1451 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:30:45.316919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-828da80b-ac97-4f21-924f-d6a9c85892e3 req-faae4a7d-31da-4535-ae14-f257d5c3fa81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ca97cd-ad46-405d-8cfb-dc734e6523ab", "tag": "51f057c9-2061-42dd-866a-0fcf5ff88d0b"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:30:45.336254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-828da80b-ac97-4f21-924f-d6a9c85892e3 req-faae4a7d-31da-4535-ae14-f257d5c3fa81 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:30:45.337150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-828da80b-ac97-4f21-924f-d6a9c85892e3 req-faae4a7d-31da-4535-ae14-f257d5c3fa81 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:30:45.337941 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-828da80b-ac97-4f21-924f-d6a9c85892e3 req-faae4a7d-31da-4535-ae14-f257d5c3fa81 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:30:45.362844 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-828da80b-ac97-4f21-924f-d6a9c85892e3 req-faae4a7d-31da-4535-ae14-f257d5c3fa81 service nova] Creating event network-changed:51f057c9-2061-42dd-866a-0fcf5ff88d0b for instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab on hv-cinder-83538 Aug 17 20:30:45.371884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-828da80b-ac97-4f21-924f-d6a9c85892e3 req-faae4a7d-31da-4535-ae14-f257d5c3fa81 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060421 Aug 17 20:30:45.372973 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 520/1040] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:30:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:06.313563 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:06.314167 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:06.317133 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=17 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:06.317836 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=41 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:06.323951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.324450 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.324887 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:06.325851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.326300 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.326753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:06.352733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-91b977a6-80e7-4739-b349-e1684e85c35d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049/ips" status: 200 len: 148 microversion: 2.1 time: 0.044057 Aug 17 20:31:06.353325 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 521/1041] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:31:06 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049/ips => generated 148 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:06.366770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=19 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:06.368034 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=54 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:06.381716 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "929f72f9-a920-45c5-9226-35b7d72f2cce"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:06.386367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:06.397375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.398469 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.399100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:06.400366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.401057 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.401627 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:06.496998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Invalid volume: volume 929f72f9-a920-45c5-9226-35b7d72f2cce is already attached to instances: c9caaec6-d09c-42fe-a068-150f69501964 Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: POST /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049/os-volume_attachments HTTP/1.1 Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 74 Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:31:06.498766 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {"volumeAttachment": {"volumeId": "929f72f9-a920-45c5-9226-35b7d72f2cce"}} Aug 17 20:31:06.500461 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Invalid volume: volume 929f72f9-a920-45c5-9226-35b7d72f2cce is already attached to instances: c9caaec6-d09c-42fe-a068-150f69501964 Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'server_id': '0e7994a9-636a-40a4-8034-ec4dd4c23049', 'body': {'volumeAttachment': {'volumeId': '929f72f9-a920-45c5-9226-35b7d72f2cce'}}} Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 929f72f9-a920-45c5-9226-35b7d72f2cce is already attached to instances: c9caaec6-d09c-42fe-a068-150f69501964 Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:31:06.501419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 929f72f9-a920-45c5-9226-35b7d72f2cce is already attached to instances: c9caaec6-d09c-42fe-a068-150f69501964 Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:06.502910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 929f72f9-a920-45c5-9226-35b7d72f2cce is already attached to instances: c9caaec6-d09c-42fe-a068-150f69501964 Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 400 to user: Invalid volume: volume 929f72f9-a920-45c5-9226-35b7d72f2cce is already attached to instances: c9caaec6-d09c-42fe-a068-150f69501964 {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9bc4a0e7-c9c8-42e6-a839-2f141526886c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.137764 Aug 17 20:31:06.504636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 521/1042] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:31:06 2022] POST /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049/os-volume_attachments => generated 174 bytes in 140 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:31:06.510420 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:06.510948 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:06.517218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.523181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.523181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:06.523181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.523181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.524075 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:06.551521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:31:06.932225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d236f64c-fcb5-42fe-9688-86061d266b7f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 204 len: 0 microversion: 2.1 time: 0.426036 Aug 17 20:31:06.932590 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 522/1043] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:31:06 2022] DELETE /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:31:06.944341 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:06.945189 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:06.953124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.953620 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.954055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:06.954799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:06.955251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:06.955674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:07.131223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:07.144924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4e7890a3-2086-4ac4-b16c-d75bf7b7cbbd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1680 microversion: 2.1 time: 0.204692 Aug 17 20:31:07.145517 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 522/1044] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:06 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1680 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:08.168454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:08.169162 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:08.178793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:08.178793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:08.178793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:08.178793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:08.179229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:08.179229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:08.323928 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:08.331773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9a905b79-095d-4e61-a581-b81ff871fed4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1680 microversion: 2.1 time: 0.167827 Aug 17 20:31:08.332349 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 523/1045] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:08 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1680 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:31:09.353619 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:09.355142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:09.362267 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:09.363061 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:09.363505 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:09.364273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:09.364790 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:09.365218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:09.532367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:09.542562 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-89916a16-f591-4893-ab69-67de16422987 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1680 microversion: 2.1 time: 0.192952 Aug 17 20:31:09.547167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 523/1046] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:09 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1680 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:31:09.835306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-589ed199-aac9-4bb6-8d33-86cfc79d4aa8 req-a55df4d3-81be-4ced-b677-b1d62261a6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0e7994a9-636a-40a4-8034-ec4dd4c23049", "name": "network-vif-deleted", "tag": "4c498d1b-19e7-419c-a45d-d68f77a7aea8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:09.846712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-589ed199-aac9-4bb6-8d33-86cfc79d4aa8 req-a55df4d3-81be-4ced-b677-b1d62261a6c5 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:09.848203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-589ed199-aac9-4bb6-8d33-86cfc79d4aa8 req-a55df4d3-81be-4ced-b677-b1d62261a6c5 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:09.848203 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-589ed199-aac9-4bb6-8d33-86cfc79d4aa8 req-a55df4d3-81be-4ced-b677-b1d62261a6c5 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:09.860191 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-589ed199-aac9-4bb6-8d33-86cfc79d4aa8 req-a55df4d3-81be-4ced-b677-b1d62261a6c5 service nova] Creating event network-vif-deleted:4c498d1b-19e7-419c-a45d-d68f77a7aea8 for instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 on hv-cinder-83538 Aug 17 20:31:09.865278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-589ed199-aac9-4bb6-8d33-86cfc79d4aa8 req-a55df4d3-81be-4ced-b677-b1d62261a6c5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033850 Aug 17 20:31:09.866528 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 524/1047] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:10.565743 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:10.567413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:10.575172 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:10.575694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:10.576132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:10.576840 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:10.577320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:10.577745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:10.612179 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:10.612674 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:10.613112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:10.613571 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lazy-loading 'fault' on Instance uuid 0e7994a9-636a-40a4-8034-ec4dd4c23049 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:31:10.658435 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:10.680684 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-85445062-a979-4233-9452-0983f2b26389 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 200 len: 1331 microversion: 2.1 time: 0.118939 Aug 17 20:31:10.684576 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 524/1048] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:10 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 1331 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:11.712297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:11.713346 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:11.720257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:11.720748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:11.721195 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:11.721898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:11.722355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:11.722809 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:11.736770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 HTTP/1.1 Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:31:11.738452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:31:11.740274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '0e7994a9-636a-40a4-8034-ec4dd4c23049'} Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:31:11.741540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:31:11.743112 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:11.744721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:31:11.744721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6312529a-cfe4-40df-966d-b8f1173e8aef tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 404 len: 111 microversion: 2.1 time: 0.034050 Aug 17 20:31:11.744721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 525/1049] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:11 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:11.749500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-260c436d-7d8f-4264-8e00-fad0d53dece4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '.version_select at 0x7f23e1d84af0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:11.855108 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-260c436d-7d8f-4264-8e00-fad0d53dece4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471026029" status: 202 len: 0 microversion: 2.1 time: 0.109371 Aug 17 20:31:11.855730 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 525/1050] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Aug 17 20:31:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1471026029 => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:31:13.039486 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:13.040034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:13.046526 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:13.047130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:13.047558 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:13.048211 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:13.048666 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:13.049094 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:13.302281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lazy-loading 'services' on Instance uuid c9caaec6-d09c-42fe-a068-150f69501964 {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:31:13.507980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-be7d8085-7541-4fb7-ba87-05e04f52f461 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments/929f72f9-a920-45c5-9226-35b7d72f2cce" status: 202 len: 0 microversion: 2.1 time: 0.473758 Aug 17 20:31:13.508565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 526/1051] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:31:13 2022] DELETE /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments/929f72f9-a920-45c5-9226-35b7d72f2cce => generated 0 bytes in 475 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:31:13.517786 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:13.519993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:13.526814 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:13.527300 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:13.527738 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:13.528506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:13.528963 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:13.529388 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:13.561835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-1000d59b-5e1c-4b8a-9ea2-867f379b5d92 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048576 Aug 17 20:31:13.562389 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 526/1052] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:31:13 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:14.576313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:14.578561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:14.586560 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:14.587085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:14.587527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:14.588257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:14.588717 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:14.589153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:14.621257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-22bbfa96-8e2c-4145-b150-8cc9252a2867 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049984 Aug 17 20:31:14.621829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 527/1053] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:31:14 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:15.633993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:15.636220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:15.642933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:15.643423 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:15.643874 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:15.644583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:15.645066 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:15.645498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:15.675854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-de557ff2-fff4-4188-90f8-317286cdbe3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045990 Aug 17 20:31:15.676425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 527/1054] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:31:15 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:31:15.739734 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:15.740239 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:15.747326 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:15.747807 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:15.748243 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:15.748958 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:15.749413 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:15.749836 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:15.776227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:31:16.050996 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c0262b4e-4f25-4bcc-b62b-948bda299aad tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 204 len: 0 microversion: 2.1 time: 0.314755 Aug 17 20:31:16.051655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 528/1055] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:31:15 2022] DELETE /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:31:16.060263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:16.060884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:16.067686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:16.068180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:16.069117 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:16.069815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:16.070278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:16.070815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:16.320142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:16.330931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-825bb254-65fa-4d0f-8267-c26afa54fce0 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1680 microversion: 2.1 time: 0.274615 Aug 17 20:31:16.331444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 528/1056] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:16 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1680 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:17.355506 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:17.356208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:17.362870 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:17.363355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:17.363791 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:17.364485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:17.364931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:17.365492 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:17.513756 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:17.522115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5f5249bb-ad94-4207-b994-f9cd0f08bb58 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1680 microversion: 2.1 time: 0.171572 Aug 17 20:31:17.523108 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 529/1057] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:17 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1680 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:18.547777 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:18.548473 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:18.555379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:18.555868 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:18.556303 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:18.557021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:18.557462 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:18.557888 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:18.692190 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:18.698903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-16893412-68b9-45d6-a80d-e87c3ae2708d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1680 microversion: 2.1 time: 0.154958 Aug 17 20:31:18.699460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 529/1058] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:18 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:19.019264 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-b8273281-fdda-4cb9-912c-b69713247ea9 req-eaccca86-bb12-426c-b1f4-6df4850fd69c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c9caaec6-d09c-42fe-a068-150f69501964", "name": "network-vif-deleted", "tag": "7ca757bb-fe42-45c4-88dd-ec2ef08ad008"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:19.029919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b8273281-fdda-4cb9-912c-b69713247ea9 req-eaccca86-bb12-426c-b1f4-6df4850fd69c service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:19.030403 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b8273281-fdda-4cb9-912c-b69713247ea9 req-eaccca86-bb12-426c-b1f4-6df4850fd69c service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:19.030960 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-b8273281-fdda-4cb9-912c-b69713247ea9 req-eaccca86-bb12-426c-b1f4-6df4850fd69c service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:19.042453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-b8273281-fdda-4cb9-912c-b69713247ea9 req-eaccca86-bb12-426c-b1f4-6df4850fd69c service nova] Creating event network-vif-deleted:7ca757bb-fe42-45c4-88dd-ec2ef08ad008 for instance c9caaec6-d09c-42fe-a068-150f69501964 on hv-cinder-83538 Aug 17 20:31:19.047521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-b8273281-fdda-4cb9-912c-b69713247ea9 req-eaccca86-bb12-426c-b1f4-6df4850fd69c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032410 Aug 17 20:31:19.048110 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 530/1059] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:19.720790 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:19.721405 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:19.728552 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:19.729035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:19.729471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:19.730174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:19.730643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:19.731076 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:19.767737 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:19.768318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:19.768753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:19.769202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lazy-loading 'fault' on Instance uuid c9caaec6-d09c-42fe-a068-150f69501964 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:31:19.815326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:19.824016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f1521e05-4d13-40da-8e68-737a31afdfe6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 200 len: 1330 microversion: 2.1 time: 0.107045 Aug 17 20:31:19.824597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 530/1060] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:19 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 1330 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:20.847339 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:20.848039 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:20.855231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:20.855718 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:20.856158 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:20.856857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:20.857313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:20.857738 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:20.872780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 HTTP/1.1 Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:31:20.874455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:31:20.876057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': 'c9caaec6-d09c-42fe-a068-150f69501964'} Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:31:20.876977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:31:20.878555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:20.880004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:31:20.880004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-67e4ed73-738d-4b83-b79b-47aaf53508fb tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 404 len: 111 microversion: 2.1 time: 0.033425 Aug 17 20:31:20.880004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 531/1061] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:20 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:20.885499 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c5610df5-f51b-458d-a48c-abe9cff8eba8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '.version_select at 0x7f23e1ffa9d0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:20.960760 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c5610df5-f51b-458d-a48c-abe9cff8eba8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-802589749" status: 202 len: 0 microversion: 2.1 time: 0.079084 Aug 17 20:31:20.961399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 531/1062] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 17 20:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-802589749 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:31:21.748415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2fb50613-3e2c-45eb-a101-0631d46a79f5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: .version_select at 0x7f23e1bd6f70>, body: {"keypair": {"name": "tempest-keypair-2072892658", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInvZ2ToszC5d7yfU9Kf3oiic/ya0ydSjJmkav99BKURGp5cl2Fz2GRg1D0mX2VtCjiE9QahvtocT2reTojZJP3dkqNW/tUcY0C3oTsz23wkClOFphn0DVL74NJMu1QQvg=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:21.764674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-2fb50613-3e2c-45eb-a101-0631d46a79f5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:31:21.768639 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-2fb50613-3e2c-45eb-a101-0631d46a79f5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:31:21.874844 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2fb50613-3e2c-45eb-a101-0631d46a79f5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.130417 Aug 17 20:31:21.875491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 532/1063] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:31:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:24.283476 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1436870699", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31711876-3b7e-4c5a-9dfe-2ee7155c4a36"}], "security_groups": [{"name": "tempest-securitygroup--683817313"}], "key_name": "tempest-keypair-2072892658", "user_data": "}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:24.396734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] validate_networks() for [('31711876-3b7e-4c5a-9dfe-2ee7155c4a36', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:31:24.786530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:31:24.786989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:31:24.787760 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:31:24.788180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:31:24.788598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:31:24.797622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:24.798104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:24.798541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:24.799305 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:24.799764 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:24.800192 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:24.817784 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:31:24.822590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:31:24.833882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:31:24.836337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:31:24.972862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9c115afb-a057-4e96-8afc-ea101d0bdf84 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.694295 Aug 17 20:31:24.973592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 532/1064] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:31:24 2022] POST /compute/v2.1/servers => generated 401 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:31:24.985271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4dc3896e-693e-4a31-8abd-5bfa109ca30a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:24.991764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4dc3896e-693e-4a31-8abd-5bfa109ca30a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:25.044873 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4dc3896e-693e-4a31-8abd-5bfa109ca30a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:25.052358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4dc3896e-693e-4a31-8abd-5bfa109ca30a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1242 microversion: 2.1 time: 0.071363 Aug 17 20:31:25.052977 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 533/1065] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:24 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1242 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:26.075588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:26.076248 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:26.083946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:26.084660 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:26.085269 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:26.086185 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:26.086652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:26.087097 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:26.152255 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:26.162021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-48146026-89f2-453a-a4b1-3a3d7e450a9e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1246 microversion: 2.1 time: 0.090854 Aug 17 20:31:26.163255 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 533/1066] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:26 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:27.184054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:27.184689 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:27.191017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:27.191603 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:27.191904 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:27.192621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:27.193091 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:27.193583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:27.258841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:27.266484 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1e837d03-9021-4f60-8fa6-41350ea9c5cf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1238 microversion: 2.1 time: 0.086314 Aug 17 20:31:27.267084 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 534/1067] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:27 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1238 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:28.289565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:28.290309 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:28.298009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:28.298837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:28.299172 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:28.308630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:28.308630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:28.308630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:28.374464 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:28.383416 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3819724b-3fb3-496a-9f00-5a5efd7476ee tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1302 microversion: 2.1 time: 0.098819 Aug 17 20:31:28.384003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 534/1068] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:28 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1302 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:29.404327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:29.405236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:29.412406 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:29.413459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:29.413459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:29.414048 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:29.414510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:29.414955 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:29.581039 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:29.589727 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4086f468-20fd-48c9-abdd-e74bfef9b2ca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.189291 Aug 17 20:31:29.590399 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 535/1069] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:29 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:31:30.470987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-bb6c38a9-254c-4e30-bfb7-70f18790ad8d req-65172235-5f7c-4231-9002-f2db818518c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b5fe96-982a-4e75-be6e-365e043c1cda", "tag": "bcc72007-add1-45e8-bbf5-913647626d8c"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:30.482606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-bb6c38a9-254c-4e30-bfb7-70f18790ad8d req-65172235-5f7c-4231-9002-f2db818518c8 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:30.483169 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-bb6c38a9-254c-4e30-bfb7-70f18790ad8d req-65172235-5f7c-4231-9002-f2db818518c8 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:30.483620 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-bb6c38a9-254c-4e30-bfb7-70f18790ad8d req-65172235-5f7c-4231-9002-f2db818518c8 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:30.495251 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-bb6c38a9-254c-4e30-bfb7-70f18790ad8d req-65172235-5f7c-4231-9002-f2db818518c8 service nova] Creating event network-changed:bcc72007-add1-45e8-bbf5-913647626d8c for instance 60b5fe96-982a-4e75-be6e-365e043c1cda on hv-cinder-83538 Aug 17 20:31:30.500594 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-bb6c38a9-254c-4e30-bfb7-70f18790ad8d req-65172235-5f7c-4231-9002-f2db818518c8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033648 Aug 17 20:31:30.501626 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 535/1070] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:30.613239 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:30.614472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:30.621509 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:30.622076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:30.622580 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:30.623398 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:30.623919 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:30.624536 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:30.777259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:30.785638 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6f94a98a-9d56-41d0-897e-9aafda49c141 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.177462 Aug 17 20:31:30.786442 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 536/1071] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:30 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:31.808114 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:31.808748 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:31.815830 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:31.816328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:31.818027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:31.818027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:31.818027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:31.818495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:31.956162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:31.964756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5a5c3567-b05d-4843-ae01-b1b87cba4b27 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.161702 Aug 17 20:31:31.965454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 536/1072] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:31 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:32.985888 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:32.986597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:32.993728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:32.994551 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:32.995049 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:32.995755 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:32.996218 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:32.996643 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:33.134177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:33.142675 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2ee82a5e-f168-4b1b-9bb8-f812b85f402d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.160783 Aug 17 20:31:33.154657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 537/1073] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:32 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:34.164686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:34.165330 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:34.172987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:34.173484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:34.173925 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:34.174662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:34.175118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:34.175549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:34.342926 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:34.350916 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d5d0711e-0cc7-425e-ac2b-e27d6edfa231 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.190133 Aug 17 20:31:34.351858 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 537/1074] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:34 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:35.375662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:35.376642 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:35.380730 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=6 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:35.391137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:35.392015 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:35.392801 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:35.394062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:35.394913 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:35.395688 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:35.422219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:35.553633 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:35.562658 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1f846ff9-0686-4690-8de4-b9bcda3e110d tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.193459 Aug 17 20:31:35.563249 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 538/1075] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:35 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:36.585061 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:36.585677 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:36.587755 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:36.588489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=6 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:36.594669 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:36.595181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:36.595631 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:36.596349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:36.596810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:36.597238 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:36.750372 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:36.758342 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-43477cf5-75d3-43c5-90c0-9b18fd1794dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.177301 Aug 17 20:31:36.758961 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 538/1076] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:36 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:37.407166 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-e9c1586b-3011-48bb-b92c-182422e0130b req-3bc6836d-26a9-4321-ba3d-bd017d08dc03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b5fe96-982a-4e75-be6e-365e043c1cda", "name": "network-vif-plugged", "status": "completed", "tag": "bcc72007-add1-45e8-bbf5-913647626d8c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:37.414783 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=58,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:37.420327 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e9c1586b-3011-48bb-b92c-182422e0130b req-3bc6836d-26a9-4321-ba3d-bd017d08dc03 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:37.421038 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e9c1586b-3011-48bb-b92c-182422e0130b req-3bc6836d-26a9-4321-ba3d-bd017d08dc03 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:37.421469 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e9c1586b-3011-48bb-b92c-182422e0130b req-3bc6836d-26a9-4321-ba3d-bd017d08dc03 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:37.433345 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-e9c1586b-3011-48bb-b92c-182422e0130b req-3bc6836d-26a9-4321-ba3d-bd017d08dc03 service nova] Creating event network-vif-plugged:bcc72007-add1-45e8-bbf5-913647626d8c for instance 60b5fe96-982a-4e75-be6e-365e043c1cda on hv-cinder-83538 Aug 17 20:31:37.439703 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-e9c1586b-3011-48bb-b92c-182422e0130b req-3bc6836d-26a9-4321-ba3d-bd017d08dc03 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040742 Aug 17 20:31:37.440555 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 539/1077] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:37.779838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:37.780454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:37.783075 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:37.787879 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:37.788365 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:37.788802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:37.789521 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:37.789978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:37.790429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:37.793519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=93 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:37.934220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:37.942180 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-24411bb7-c15c-4fec-8f9c-71a856019b33 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.166564 Aug 17 20:31:37.943092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 539/1078] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:37 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:38.965953 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:38.967257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:38.975347 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:38.975841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:38.976281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:38.976991 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:38.977451 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:38.977881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:39.120336 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:39.128591 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f78d5bb7-f2cc-4816-97a6-8f4363488f1e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1367 microversion: 2.1 time: 0.167789 Aug 17 20:31:39.129254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 540/1079] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:38 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:39.372016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2146082432", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "networks": [{"uuid": "b21f30d5-b803-4652-9b4d-5b4e1d9e8213"}]}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:39.429243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] validate_networks() for [('b21f30d5-b803-4652-9b4d-5b4e1d9e8213', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:31:39.806978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:31:39.807527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:31:39.807890 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:31:39.808310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:31:39.808751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:31:39.819012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:39.819530 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:39.819967 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:39.820756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:39.821241 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:39.821677 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:39.839413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Getting quotas for project ac8091c750f949febb518d0fcf9f70e2. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:31:39.843553 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Getting quotas for user 431f8ed26add4980ae17be823b63e30d and project ac8091c750f949febb518d0fcf9f70e2. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:31:39.855422 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:31:39.858312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:31:40.021125 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-25652c7d-bd30-49fc-a7c4-2d2ab301ded3 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.654025 Aug 17 20:31:40.022082 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 540/1080] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:31:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 656 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:31:40.032911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-860b0758-5932-4e35-a07d-4a24714c0c00 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:40.033531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-860b0758-5932-4e35-a07d-4a24714c0c00 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:40.090695 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-860b0758-5932-4e35-a07d-4a24714c0c00 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:40.097774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-860b0758-5932-4e35-a07d-4a24714c0c00 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1214 microversion: 2.1 time: 0.068955 Aug 17 20:31:40.098356 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 541/1081] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:40 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1214 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:40.150378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:40.151229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:40.158029 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:40.158450 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:40.158897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:40.159575 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:40.160118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:40.160652 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:40.296226 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:40.303983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-08548460-4b96-4189-8d96-63a7f70e2e60 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1557 microversion: 2.1 time: 0.157663 Aug 17 20:31:40.304550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 541/1082] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:40 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:40.324959 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:40.325582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:40.332890 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:40.333422 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:40.333869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:40.334563 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:40.335092 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:40.335519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:40.421871 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9fbd7aef-bcca-4f1a-9029-37ac93996b47 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100985 Aug 17 20:31:40.422468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 542/1083] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:31:40 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:41.120313 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-07cad85f-c4c5-4a35-b04c-cf70d9e04332 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:41.121146 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-07cad85f-c4c5-4a35-b04c-cf70d9e04332 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:41.176610 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-07cad85f-c4c5-4a35-b04c-cf70d9e04332 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:41.183472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-07cad85f-c4c5-4a35-b04c-cf70d9e04332 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1214 microversion: 2.1 time: 0.067844 Aug 17 20:31:41.186887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 542/1084] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:41 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1214 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:41.535416 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-c38fc121-6515-4711-9f3f-f371f4ffde6f req-ce5e166d-947c-42b3-b7ff-59d1c250edcd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "60b5fe96-982a-4e75-be6e-365e043c1cda", "tag": "bcc72007-add1-45e8-bbf5-913647626d8c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:41.546248 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c38fc121-6515-4711-9f3f-f371f4ffde6f req-ce5e166d-947c-42b3-b7ff-59d1c250edcd service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:41.546759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c38fc121-6515-4711-9f3f-f371f4ffde6f req-ce5e166d-947c-42b3-b7ff-59d1c250edcd service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:41.547192 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-c38fc121-6515-4711-9f3f-f371f4ffde6f req-ce5e166d-947c-42b3-b7ff-59d1c250edcd service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:41.558690 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-c38fc121-6515-4711-9f3f-f371f4ffde6f req-ce5e166d-947c-42b3-b7ff-59d1c250edcd service nova] Creating event network-changed:bcc72007-add1-45e8-bbf5-913647626d8c for instance 60b5fe96-982a-4e75-be6e-365e043c1cda on hv-cinder-83538 Aug 17 20:31:41.564405 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-c38fc121-6515-4711-9f3f-f371f4ffde6f req-ce5e166d-947c-42b3-b7ff-59d1c250edcd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033881 Aug 17 20:31:41.565006 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 543/1085] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:31:42.205885 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:42.206529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:42.214062 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:42.214551 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:42.215030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:42.215726 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:42.216390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:42.216882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:42.284601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:42.292739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f539dce3-20f0-4bc5-96e4-48fc18ee2770 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1266 microversion: 2.1 time: 0.090837 Aug 17 20:31:42.293329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 543/1086] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:42 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1266 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:43.317131 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:43.318468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:43.325047 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:43.325920 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:43.326460 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:43.327251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:43.327714 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:43.328134 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:43.395613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:43.403155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6264b057-b933-422a-a1e7-0e6797f857b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1272 microversion: 2.1 time: 0.091830 Aug 17 20:31:43.404305 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 544/1087] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:43 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:31:44.427344 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:44.434123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:44.436431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:44.436938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:44.437378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:44.438100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:44.438557 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:44.439014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:44.568336 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a7238996-4790-4b8e-8cd6-565c4e08341d req-ee8b4f08-6fb9-447e-85f3-091cdbd64a42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c17d145-2989-462f-a3dc-99d22a6a7161", "tag": "56696b4f-66b4-4d90-b572-e29f59d8d4d7"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:44.578019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a7238996-4790-4b8e-8cd6-565c4e08341d req-ee8b4f08-6fb9-447e-85f3-091cdbd64a42 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:44.578851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a7238996-4790-4b8e-8cd6-565c4e08341d req-ee8b4f08-6fb9-447e-85f3-091cdbd64a42 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:44.580715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a7238996-4790-4b8e-8cd6-565c4e08341d req-ee8b4f08-6fb9-447e-85f3-091cdbd64a42 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:44.591504 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a7238996-4790-4b8e-8cd6-565c4e08341d req-ee8b4f08-6fb9-447e-85f3-091cdbd64a42 service nova] Creating event network-changed:56696b4f-66b4-4d90-b572-e29f59d8d4d7 for instance 2c17d145-2989-462f-a3dc-99d22a6a7161 on hv-cinder-83538 Aug 17 20:31:44.597334 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a7238996-4790-4b8e-8cd6-565c4e08341d req-ee8b4f08-6fb9-447e-85f3-091cdbd64a42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033662 Aug 17 20:31:44.597958 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 545/1088] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:31:44.615174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:44.619475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0d4014ad-1edd-4ad0-a011-23c2d8f3d4cf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.196709 Aug 17 20:31:44.620065 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 544/1089] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:44 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:45.643672 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:45.644389 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:45.650940 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:45.651432 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:45.651870 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:45.652588 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:45.653083 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:45.653643 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:45.820440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:45.830876 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-9af441be-db29-4634-ab26-17632408f55b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.192682 Aug 17 20:31:45.831817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 546/1090] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:45 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:46.853035 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:46.853650 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:46.860367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:46.860916 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:46.861359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:46.862057 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:46.862512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:46.862977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:47.009400 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:47.018810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8d475148-f877-4274-86c9-6dd4e303f490 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.169664 Aug 17 20:31:47.019398 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 545/1091] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:46 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:48.048128 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:48.048793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:48.055324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:48.056381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:48.056381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:48.056954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:48.057426 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:48.057839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:48.201091 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:48.209324 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0bd03fe1-af8e-4cb5-8920-7e3bf997c5d2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.165821 Aug 17 20:31:48.209931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 547/1092] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:48 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:49.231436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:49.232012 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:49.239221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:49.244809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:49.244809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:49.244809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:49.244809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:49.245224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:49.388746 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:49.397027 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-10fbab0d-0de0-4070-979a-66c6b156db80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.169672 Aug 17 20:31:49.397609 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 546/1093] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:49 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:50.419174 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:50.419862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:50.422758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:50.427732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:50.428227 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:50.428674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:50.429385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:50.429839 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:50.430269 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:50.588732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:50.600149 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8f17c044-cbd8-49ce-be70-edabc92fe0bf tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.184983 Aug 17 20:31:50.601095 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 548/1094] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:50 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:31:51.191386 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-d1b2daa4-1aaa-435e-9b6e-130a9f64d1a3 req-cfb51d1b-8122-4ef6-a999-8df7e85e1413 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c17d145-2989-462f-a3dc-99d22a6a7161", "name": "network-vif-plugged", "status": "completed", "tag": "56696b4f-66b4-4d90-b572-e29f59d8d4d7"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:51.196336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:51.197482 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=8 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:31:51.203335 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-d1b2daa4-1aaa-435e-9b6e-130a9f64d1a3 req-cfb51d1b-8122-4ef6-a999-8df7e85e1413 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:51.203809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-d1b2daa4-1aaa-435e-9b6e-130a9f64d1a3 req-cfb51d1b-8122-4ef6-a999-8df7e85e1413 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:51.204235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-d1b2daa4-1aaa-435e-9b6e-130a9f64d1a3 req-cfb51d1b-8122-4ef6-a999-8df7e85e1413 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:51.215572 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-d1b2daa4-1aaa-435e-9b6e-130a9f64d1a3 req-cfb51d1b-8122-4ef6-a999-8df7e85e1413 service nova] Creating event network-vif-plugged:56696b4f-66b4-4d90-b572-e29f59d8d4d7 for instance 2c17d145-2989-462f-a3dc-99d22a6a7161 on hv-cinder-83538 Aug 17 20:31:51.221540 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-d1b2daa4-1aaa-435e-9b6e-130a9f64d1a3 req-cfb51d1b-8122-4ef6-a999-8df7e85e1413 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Aug 17 20:31:51.222148 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 547/1095] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:51.621777 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:51.622411 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:51.629931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:51.630452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:51.630912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:51.631637 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:51.632087 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:51.632505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:51.789016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:51.797199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d2fcfa59-7337-4e0f-9821-6cec76487cdb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.179566 Aug 17 20:31:51.803236 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 549/1096] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:51 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:52.821003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:52.821696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:52.829051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:52.829542 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:52.829978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:52.830731 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:52.831167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:52.831591 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:52.976488 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:52.984922 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4d25cf00-7ed2-46a9-bd6d-5053d9fdc085 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1314 microversion: 2.1 time: 0.169119 Aug 17 20:31:52.985494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 548/1097] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:52 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:54.005534 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:54.006076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:54.012915 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:54.013410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:54.014618 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:54.015469 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:54.015935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:54.016367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:54.155654 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:54.163724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b91a3051-90d9-41d9-9e95-e922730a61b4 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1497 microversion: 2.1 time: 0.162070 Aug 17 20:31:54.164312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 550/1098] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:54 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1497 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:55.232036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:55.233318 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:55.240098 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:55.240601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:55.241036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:55.241813 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:55.242283 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:55.242745 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:55.271431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:31:55.608016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cde85852-ee79-49a2-b0df-6eb8c07ea8e9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "DELETE /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 204 len: 0 microversion: 2.1 time: 0.379227 Aug 17 20:31:55.608751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 549/1099] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:31:55 2022] DELETE /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:31:55.617367 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:55.617962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:55.625554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:55.626035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:55.626483 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:55.627226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:55.627687 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:55.628180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:55.780385 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:55.788474 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a40af811-2666-4e0d-a775-e7d3fb531021 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1503 microversion: 2.1 time: 0.175039 Aug 17 20:31:55.789312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 551/1100] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:55 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1503 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:56.811040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:56.811849 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:56.818519 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:56.819040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:56.819480 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:56.820190 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:56.820651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:56.821079 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:56.962803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:56.972241 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-f475d7a5-6963-49f2-b582-b25cb6f166b1 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1503 microversion: 2.1 time: 0.165705 Aug 17 20:31:56.972698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 550/1101] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:56 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:31:57.993761 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:57.995092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:58.002117 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:58.002998 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:58.003141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:58.003959 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:58.004418 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:58.004842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:58.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-a6b44e6f-d9af-4d34-8578-cffb45dd5376 req-6560d0d2-808c-42d9-abca-297541a8127c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c17d145-2989-462f-a3dc-99d22a6a7161", "name": "network-vif-deleted", "tag": "56696b4f-66b4-4d90-b572-e29f59d8d4d7"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:58.046094 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a6b44e6f-d9af-4d34-8578-cffb45dd5376 req-6560d0d2-808c-42d9-abca-297541a8127c service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:58.046584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a6b44e6f-d9af-4d34-8578-cffb45dd5376 req-6560d0d2-808c-42d9-abca-297541a8127c service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:58.047057 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-a6b44e6f-d9af-4d34-8578-cffb45dd5376 req-6560d0d2-808c-42d9-abca-297541a8127c service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:58.062452 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-a6b44e6f-d9af-4d34-8578-cffb45dd5376 req-6560d0d2-808c-42d9-abca-297541a8127c service nova] Creating event network-vif-deleted:56696b4f-66b4-4d90-b572-e29f59d8d4d7 for instance 2c17d145-2989-462f-a3dc-99d22a6a7161 on hv-cinder-83538 Aug 17 20:31:58.068267 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-a6b44e6f-d9af-4d34-8578-cffb45dd5376 req-6560d0d2-808c-42d9-abca-297541a8127c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.174817 Aug 17 20:31:58.068874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 552/1102] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:31:58.088734 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:58.097570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-182fca2a-ed67-4d4e-af1b-06fa46fe37da tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 200 len: 1461 microversion: 2.1 time: 0.107916 Aug 17 20:31:58.098160 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 551/1103] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:57 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 1461 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:31:59.121582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:59.122276 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 2c17d145-2989-462f-a3dc-99d22a6a7161] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:59.128754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:59.129247 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:59.129756 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:59.130464 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:59.130955 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:59.131415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:59.146254 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] HTTP exception thrown: Instance 2c17d145-2989-462f-a3dc-99d22a6a7161 could not be found. Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Request method failure captured: Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 HTTP/1.1 Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_VApwhp_KCKpysSjH0TXMP6nCjOSciQfKac3K6bUe1eJRwXUVWiWGVlRpgatm3L1FUyDcJqxj2UmwbSO75Tt6lLcYWXWHeWTdbOLdLfbqhDwgRg38KdBH679lX7x-7rDWuGyyZc6i9ISBk5J6v5MgzNl12NTEmnzgSUhzdC3OTkZqJs Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ac8091c750f949febb518d0fcf9f70e2 Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-VolumesActionsTest-1054756928 Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:31:59.147963 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-VolumesActionsTest-1054756928 Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ac8091c750f949febb518d0fcf9f70e2 Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-VolumesActionsTest-1054756928 Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-VolumesActionsTest-1054756928-project Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 431f8ed26add4980ae17be823b63e30d Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-VolumesActionsTest-1054756928-project Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 2c17d145-2989-462f-a3dc-99d22a6a7161 could not be found. Aug 17 20:31:59.149758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '2c17d145-2989-462f-a3dc-99d22a6a7161'} Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c17d145-2989-462f-a3dc-99d22a6a7161 could not be found. Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:31:59.150985 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c17d145-2989-462f-a3dc-99d22a6a7161 could not be found. Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c17d145-2989-462f-a3dc-99d22a6a7161 could not be found. Aug 17 20:31:59.152513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:31:59.153891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Returning 404 to user: Instance 2c17d145-2989-462f-a3dc-99d22a6a7161 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:31:59.153891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1283d86a-fb77-48c0-ac51-a01e78a8909f tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161" status: 404 len: 111 microversion: 2.1 time: 0.033009 Aug 17 20:31:59.153891 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 553/1104] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:59 2022] GET /compute/v2.1/servers/2c17d145-2989-462f-a3dc-99d22a6a7161 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:31:59.204176 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1604482308", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "networks": [{"uuid": "b21f30d5-b803-4652-9b4d-5b4e1d9e8213"}]}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:31:59.266845 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] validate_networks() for [('b21f30d5-b803-4652-9b4d-5b4e1d9e8213', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:31:59.649033 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:31:59.649493 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:31:59.649991 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:31:59.650444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:31:59.650962 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:31:59.661554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:59.663310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:59.663310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:59.663310 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:31:59.663711 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:31:59.664137 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:31:59.683727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Getting quotas for project ac8091c750f949febb518d0fcf9f70e2. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:31:59.692535 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Getting quotas for user 431f8ed26add4980ae17be823b63e30d and project ac8091c750f949febb518d0fcf9f70e2. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:31:59.703113 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:31:59.705469 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:31:59.851527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-66aec393-1e00-4c4e-b8f2-6d92005bce2a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651852 Aug 17 20:31:59.856543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 552/1105] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:31:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:31:59.863700 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-42e85a18-8de1-4c41-8246-b6457260b891 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:31:59.864329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-42e85a18-8de1-4c41-8246-b6457260b891 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:31:59.925414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-42e85a18-8de1-4c41-8246-b6457260b891 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:31:59.932127 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-42e85a18-8de1-4c41-8246-b6457260b891 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1214 microversion: 2.1 time: 0.072260 Aug 17 20:31:59.932696 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 554/1106] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:31:59 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1214 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:00.954785 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:00.955598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:00.965366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:00.973865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:00.973865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:00.973865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:00.973865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:00.974311 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:01.043380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:01.053062 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-fec1287e-4f9f-409f-8243-e043937a55e5 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1218 microversion: 2.1 time: 0.103334 Aug 17 20:32:01.053622 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 553/1107] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:00 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1218 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:02.075137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:02.077015 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:02.085682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:02.086316 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:02.086773 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:02.087697 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:02.088162 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:02.088594 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:02.157539 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:02.165814 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-94abb766-f823-45bc-80d9-0417cdd295c2 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1266 microversion: 2.1 time: 0.094581 Aug 17 20:32:02.166386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 555/1108] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:02 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:03.187516 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:03.188091 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:03.195154 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:03.195650 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:03.196090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:03.196799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:03.197259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:03.197683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:03.347120 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:03.355006 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-37bece00-39dc-451d-b0b3-b48e9c8955fb tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.171535 Aug 17 20:32:03.355592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 554/1109] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:03 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:04.062318 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-13340dcd-017c-4dc7-afc5-dbfcfa3768c3 req-510729f3-3136-453f-a7f6-ac61a0ab5403 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23c563d2-b74c-42c8-9b7f-b022f5ec17bf", "tag": "a95215d2-881a-4609-95d5-43cf056b5748"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:04.074510 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-13340dcd-017c-4dc7-afc5-dbfcfa3768c3 req-510729f3-3136-453f-a7f6-ac61a0ab5403 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:04.075212 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-13340dcd-017c-4dc7-afc5-dbfcfa3768c3 req-510729f3-3136-453f-a7f6-ac61a0ab5403 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:04.075571 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-13340dcd-017c-4dc7-afc5-dbfcfa3768c3 req-510729f3-3136-453f-a7f6-ac61a0ab5403 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:04.087525 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-13340dcd-017c-4dc7-afc5-dbfcfa3768c3 req-510729f3-3136-453f-a7f6-ac61a0ab5403 service nova] Creating event network-changed:a95215d2-881a-4609-95d5-43cf056b5748 for instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf on hv-cinder-83538 Aug 17 20:32:04.093864 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-13340dcd-017c-4dc7-afc5-dbfcfa3768c3 req-510729f3-3136-453f-a7f6-ac61a0ab5403 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035710 Aug 17 20:32:04.094491 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 556/1110] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:04.381585 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:04.382326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:04.390918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:04.391465 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:04.391941 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:04.392914 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:04.393695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:04.394260 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:04.545048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:04.555096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-521bb8df-14ac-433e-a969-e51e07a2ec0a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.178586 Aug 17 20:32:04.555688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 555/1111] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:04 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:05.579822 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:05.580547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:05.587753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:05.588247 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:05.588693 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:05.589407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:05.589868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:05.590328 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:05.732053 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:05.740259 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3e124768-0ebd-48da-a9a3-d975268d15c9 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.165561 Aug 17 20:32:05.740818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 557/1112] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:05 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:06.762589 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:06.763233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:06.770669 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:06.771174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:06.771616 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:06.772327 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:06.772815 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:06.773263 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:06.920668 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:06.929379 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-61a24a77-ed66-4ea4-86f7-687a411cec1c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.170916 Aug 17 20:32:06.929983 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 556/1113] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:06 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:07.953796 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:07.954879 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:07.965358 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:07.965927 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:07.966465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:07.967415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:07.968722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:07.969239 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:08.114313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:08.122693 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d59c436f-80de-4adf-a0fe-b4f6999af93c tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.174698 Aug 17 20:32:08.123336 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 558/1114] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:07 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:09.144768 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:09.145438 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:09.152999 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:09.153498 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:09.153957 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:09.154702 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:09.155816 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:09.156254 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:09.160996 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:09.330435 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:09.339114 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-bd5903f7-f839-4c7b-ac3c-a6917b28ff80 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.198298 Aug 17 20:32:09.339706 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 557/1115] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:09 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:10.361872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:10.362714 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:10.365603 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:10.366406 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=44 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:10.371896 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:10.372395 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:10.372847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:10.373565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:10.374739 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:10.375183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:10.378153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=85 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:10.527881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:10.537247 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-957c0c9d-9407-47d4-b897-18a045ecbf7b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.179299 Aug 17 20:32:10.537859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 559/1116] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:10 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:11.297663 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:11.298816 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=6 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:11.364407 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-f0f02016-a3e3-41f2-a463-9f2d59835943 req-59661ba5-bfc2-484e-aa2a-6dd04bfdb6f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c563d2-b74c-42c8-9b7f-b022f5ec17bf", "name": "network-vif-plugged", "status": "completed", "tag": "a95215d2-881a-4609-95d5-43cf056b5748"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:11.369887 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:11.376914 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f0f02016-a3e3-41f2-a463-9f2d59835943 req-59661ba5-bfc2-484e-aa2a-6dd04bfdb6f4 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:11.377334 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f0f02016-a3e3-41f2-a463-9f2d59835943 req-59661ba5-bfc2-484e-aa2a-6dd04bfdb6f4 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:11.377770 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-f0f02016-a3e3-41f2-a463-9f2d59835943 req-59661ba5-bfc2-484e-aa2a-6dd04bfdb6f4 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:11.390090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-f0f02016-a3e3-41f2-a463-9f2d59835943 req-59661ba5-bfc2-484e-aa2a-6dd04bfdb6f4 service nova] Creating event network-vif-plugged:a95215d2-881a-4609-95d5-43cf056b5748 for instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf on hv-cinder-83538 Aug 17 20:32:11.395543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-f0f02016-a3e3-41f2-a463-9f2d59835943 req-59661ba5-bfc2-484e-aa2a-6dd04bfdb6f4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103450 Aug 17 20:32:11.396425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 558/1117] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:11.559862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:11.560554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:11.568003 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:11.568496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:11.568935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:11.569640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:11.570234 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:11.570684 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:11.720065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:11.728228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-28ed7a2f-a8fa-41c9-8ea0-78135bbb1c50 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.172267 Aug 17 20:32:11.729968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 560/1118] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:11 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:12.751233 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:12.752002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:12.759191 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:12.759677 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:12.760112 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:12.760817 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:12.761270 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:12.761699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:12.931085 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:12.940437 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-eb57f3a2-ff6d-4a93-a92c-84d2ae821c06 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1314 microversion: 2.1 time: 0.194212 Aug 17 20:32:12.942364 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 559/1119] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:12 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:13.972728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:13.973286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:13.980024 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:13.980517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:13.980954 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:13.981662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:13.982159 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:13.982583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:14.136961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:14.144911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b7f55f9f-f9f0-4147-baac-c96dcb90df7a tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1497 microversion: 2.1 time: 0.176198 Aug 17 20:32:14.145501 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 561/1120] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:13 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1497 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:15.151682 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:15.152231 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:15.158833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:15.159314 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:15.159747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:15.160433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:15.160883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:15.161306 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:15.187406 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:32:15.501639 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ca971a5c-1553-4ac8-9768-6a8b808d5112 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "DELETE /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 204 len: 0 microversion: 2.1 time: 0.353455 Aug 17 20:32:15.502133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 560/1121] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:32:15 2022] DELETE /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:32:15.510566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:15.511228 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:15.518137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:15.518662 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:15.519096 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:15.519850 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:15.520364 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:15.520790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:15.661172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:15.669216 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e2acc8bc-3222-4951-93ab-3135ffdd4eef tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1503 microversion: 2.1 time: 0.162565 Aug 17 20:32:15.670017 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 562/1122] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:15 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1503 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:16.697011 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:16.698583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:16.710359 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:16.711217 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:16.712007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:16.713235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:16.714066 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:16.714891 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:16.865769 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:16.874709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-62ed21e9-b680-45ad-a0ab-500b792235f6 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1503 microversion: 2.1 time: 0.185090 Aug 17 20:32:16.875427 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 561/1123] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:16 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:17.707775 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:17.708371 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:17.715274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:17.715765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:17.716205 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:17.716935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:17.717472 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:17.717898 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:17.771614 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-5fc587dc-46b2-4868-9ec7-53ca6f5a97b1 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/ips" status: 200 len: 149 microversion: 2.1 time: 0.067326 Aug 17 20:32:17.772685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 563/1124] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:32:17 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/ips => generated 149 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:32:17.806352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-199354a1-6adc-4dd9-9e2c-760eff298143 req-cf181797-09a9-4cea-b0bf-150dac8054bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23c563d2-b74c-42c8-9b7f-b022f5ec17bf", "name": "network-vif-deleted", "tag": "a95215d2-881a-4609-95d5-43cf056b5748"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:17.825349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-199354a1-6adc-4dd9-9e2c-760eff298143 req-cf181797-09a9-4cea-b0bf-150dac8054bd service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:17.826150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-199354a1-6adc-4dd9-9e2c-760eff298143 req-cf181797-09a9-4cea-b0bf-150dac8054bd service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:17.827507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-199354a1-6adc-4dd9-9e2c-760eff298143 req-cf181797-09a9-4cea-b0bf-150dac8054bd service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:17.850401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-199354a1-6adc-4dd9-9e2c-760eff298143 req-cf181797-09a9-4cea-b0bf-150dac8054bd service nova] Creating event network-vif-deleted:a95215d2-881a-4609-95d5-43cf056b5748 for instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf on hv-cinder-83538 Aug 17 20:32:17.859794 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-199354a1-6adc-4dd9-9e2c-760eff298143 req-cf181797-09a9-4cea-b0bf-150dac8054bd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059266 Aug 17 20:32:17.861002 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 562/1125] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:17.896943 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:17.897605 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:17.907625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:17.908859 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:17.909681 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:17.910961 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:17.911721 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:17.912724 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:17.990384 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:17.999595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-219b29cc-972d-4dd6-b7ed-b1043a0fbf62 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1461 microversion: 2.1 time: 0.106383 Aug 17 20:32:17.999595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 564/1126] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:17 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1461 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:19.022581 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:19.023403 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:19.031153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:19.031794 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:19.032240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:19.032968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:19.033425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:19.033857 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:19.070886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:19.071458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:19.072141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:19.072740 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lazy-loading 'fault' on Instance uuid 23c563d2-b74c-42c8-9b7f-b022f5ec17bf {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:32:19.127975 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '431f8ed26add4980ae17be823b63e30d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ac8091c750f949febb518d0fcf9f70e2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:19.137923 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5a0c0f5e-e89a-4985-b2ed-48bb34d67c8b tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 200 len: 1304 microversion: 2.1 time: 0.119552 Aug 17 20:32:19.140417 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 563/1127] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:19 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 1304 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:19.615853 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50e8b963-a696-4571-a481-20a334a7820c"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:19.618914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:19.625134 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:19.625627 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:19.626072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:19.626823 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:19.627286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:19.627710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:20.160218 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:20.160809 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] [instance: 23c563d2-b74c-42c8-9b7f-b022f5ec17bf] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:20.167444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:20.167883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:20.168276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:20.168976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:20.169447 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:20.169854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:20.184463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] HTTP exception thrown: Instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf could not be found. Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Request method failure captured: Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf HTTP/1.1 Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_VApwhp_KCKpysSjH0TXMP6nCjOSciQfKac3K6bUe1eJRwXUVWiWGVlRpgatm3L1FUyDcJqxj2UmwbSO75Tt6lLcYWXWHeWTdbOLdLfbqhDwgRg38KdBH679lX7x-7rDWuGyyZc6i9ISBk5J6v5MgzNl12NTEmnzgSUhzdC3OTkZqJs Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ac8091c750f949febb518d0fcf9f70e2 Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-VolumesActionsTest-1054756928 Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:32:20.186750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ac8091c750f949febb518d0fcf9f70e2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-VolumesActionsTest-1054756928 Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ac8091c750f949febb518d0fcf9f70e2 Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-VolumesActionsTest-1054756928 Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-VolumesActionsTest-1054756928-project Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 431f8ed26add4980ae17be823b63e30d Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-VolumesActionsTest-1054756928-project Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf could not be found. Aug 17 20:32:20.188994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '23c563d2-b74c-42c8-9b7f-b022f5ec17bf'} Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf could not be found. Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:32:20.189985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf could not be found. Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf could not be found. Aug 17 20:32:20.191378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:20.192801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] Returning 404 to user: Instance 23c563d2-b74c-42c8-9b7f-b022f5ec17bf could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:32:20.192801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5e13333f-1979-41b5-87e5-213eef7c7471 tempest-VolumesActionsTest-1054756928 tempest-VolumesActionsTest-1054756928-project] 10.222.0.64 "GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf" status: 404 len: 111 microversion: 2.1 time: 0.032074 Aug 17 20:32:20.192801 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 564/1128] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:20 2022] GET /compute/v2.1/servers/23c563d2-b74c-42c8-9b7f-b022f5ec17bf => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 17 20:32:20.574072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0bafc784-43e8-44c9-87a3-2d5089426444 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.962874 Aug 17 20:32:20.574769 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 565/1129] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:32:19 2022] POST /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments => generated 194 bytes in 964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:29.356243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "50e8b963-a696-4571-a481-20a334a7820c"}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:29.359546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:29.368369 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:29.369010 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:29.369774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:29.371054 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:29.371847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:29.372649 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:29.490759 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Invalid volume: volume 50e8b963-a696-4571-a481-20a334a7820c is already attached to instances: 60b5fe96-982a-4e75-be6e-365e043c1cda Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: POST /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments HTTP/1.1 Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 74 Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:32:29.493456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {"volumeAttachment": {"volumeId": "50e8b963-a696-4571-a481-20a334a7820c"}} Aug 17 20:32:29.494910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Invalid volume: volume 50e8b963-a696-4571-a481-20a334a7820c is already attached to instances: 60b5fe96-982a-4e75-be6e-365e043c1cda Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'server_id': '60b5fe96-982a-4e75-be6e-365e043c1cda', 'body': {'volumeAttachment': {'volumeId': '50e8b963-a696-4571-a481-20a334a7820c'}}} Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5079, in attach_volume Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4919, in _check_volume_already_attached Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 50e8b963-a696-4571-a481-20a334a7820c is already attached to instances: 60b5fe96-982a-4e75-be6e-365e043c1cda Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:29.495723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 50e8b963-a696-4571-a481-20a334a7820c is already attached to instances: 60b5fe96-982a-4e75-be6e-365e043c1cda Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:29.497016 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:29.499021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:29.499021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:32:29.499021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:32:29.499021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 50e8b963-a696-4571-a481-20a334a7820c is already attached to instances: 60b5fe96-982a-4e75-be6e-365e043c1cda Aug 17 20:32:29.499021 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:29.501182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 400 to user: Invalid volume: volume 50e8b963-a696-4571-a481-20a334a7820c is already attached to instances: 60b5fe96-982a-4e75-be6e-365e043c1cda {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:32:29.502646 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4a367060-dcc9-4c0d-9e0f-650dbfd36bba tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.151246 Aug 17 20:32:29.503786 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 565/1130] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:32:29 2022] POST /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments => generated 174 bytes in 153 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 17 20:32:29.616909 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:29.617532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:29.624799 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:29.625750 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:29.626365 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:29.627369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:29.628185 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:29.630522 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:29.783597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lazy-loading 'services' on Instance uuid 60b5fe96-982a-4e75-be6e-365e043c1cda {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:32:30.151505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c2b3d674-6387-4ebf-aabb-b39aa5d10a65 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments/50e8b963-a696-4571-a481-20a334a7820c" status: 202 len: 0 microversion: 2.1 time: 0.539108 Aug 17 20:32:30.152546 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 566/1131] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:32:29 2022] DELETE /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments/50e8b963-a696-4571-a481-20a334a7820c => generated 0 bytes in 542 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:32:30.166273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:30.173533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:30.182416 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:30.183642 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:30.184603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:30.186539 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:30.187588 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:30.188556 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:30.248840 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ec930c40-f1ef-4962-8294-05b9d3735712 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088500 Aug 17 20:32:30.250100 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 566/1132] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:32:30 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:32:31.271380 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:31.276804 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:31.288874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:31.290130 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:31.291150 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:31.292790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:31.293983 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:31.294885 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:31.370482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ee04fe00-c504-477c-9d3b-3add6c62be02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.107952 Aug 17 20:32:31.372078 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 567/1133] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:32:31 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:32.385904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:32.388143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:32.401257 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:32.401759 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:32.402199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:32.402950 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:32.404055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:32.404055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:32.456227 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0b07e449-60a2-4457-9290-ad19fc7657d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074433 Aug 17 20:32:32.457144 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 567/1134] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:32:32 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:32:32.554430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:32.556391 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:32.570108 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:32.571360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:32.572103 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:32.573418 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:32.574225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:32.575020 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:32.611114 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:32:32.965105 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-79c20a5b-fa43-455b-80bd-25d30197f988 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 204 len: 0 microversion: 2.1 time: 0.421666 Aug 17 20:32:32.968273 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 568/1135] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:32:32 2022] DELETE /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:32:32.999471 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:33.000161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:33.010727 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:33.011228 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:33.011670 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:33.012378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:33.012826 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:33.013441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:33.178955 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:33.196069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6b1915a2-9ee3-4197-b822-1aca7bb120a6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1681 microversion: 2.1 time: 0.200715 Aug 17 20:32:33.197214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 568/1136] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:32 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1681 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:34.219951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:34.220822 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:34.235341 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:34.236473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:34.237391 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:34.239046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:34.239834 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:34.240736 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:34.442250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:34.459657 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a3b2dc3a-2e5b-412f-9f3e-914fb5befad7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1681 microversion: 2.1 time: 0.244188 Aug 17 20:32:34.475148 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 569/1137] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:34 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1681 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:35.489531 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:35.491059 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:35.501326 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:35.502969 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:35.506430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:35.506430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:35.506430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:35.506430 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:35.692835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:35.701630 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-591642fd-78fc-43d0-8836-8dfc08c6dc89 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1681 microversion: 2.1 time: 0.215761 Aug 17 20:32:35.702758 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 569/1138] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:35 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1681 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:36.236601 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-0915126a-b15a-4b0b-9f2f-6448d9008eba req-860e3c01-1c74-43f1-8969-bd58cadd1bfb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "60b5fe96-982a-4e75-be6e-365e043c1cda", "name": "network-vif-deleted", "tag": "bcc72007-add1-45e8-bbf5-913647626d8c"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:36.250288 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-0915126a-b15a-4b0b-9f2f-6448d9008eba req-860e3c01-1c74-43f1-8969-bd58cadd1bfb service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:36.251065 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-0915126a-b15a-4b0b-9f2f-6448d9008eba req-860e3c01-1c74-43f1-8969-bd58cadd1bfb service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:36.251663 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-0915126a-b15a-4b0b-9f2f-6448d9008eba req-860e3c01-1c74-43f1-8969-bd58cadd1bfb service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:36.270390 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-0915126a-b15a-4b0b-9f2f-6448d9008eba req-860e3c01-1c74-43f1-8969-bd58cadd1bfb service nova] Creating event network-vif-deleted:bcc72007-add1-45e8-bbf5-913647626d8c for instance 60b5fe96-982a-4e75-be6e-365e043c1cda on hv-cinder-83538 Aug 17 20:32:36.279361 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-0915126a-b15a-4b0b-9f2f-6448d9008eba req-860e3c01-1c74-43f1-8969-bd58cadd1bfb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048591 Aug 17 20:32:36.285016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 570/1139] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:36.724651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:36.725188 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:36.736788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:36.737293 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:36.737739 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:36.738487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:36.738990 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:36.739423 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:36.786452 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:36.787296 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:36.787901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:36.788541 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lazy-loading 'fault' on Instance uuid 60b5fe96-982a-4e75-be6e-365e043c1cda {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:32:36.835592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:36.846509 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-c1fd7603-4891-48f3-98dc-29c98f157b8a tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 200 len: 1332 microversion: 2.1 time: 0.126110 Aug 17 20:32:36.862810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 570/1140] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:36 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 1332 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:37.875293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:37.876942 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:37.887895 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:37.889263 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:37.890219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:37.891333 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:37.892100 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:37.892741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:37.917400 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda HTTP/1.1 Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:32:37.920547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:32:37.922146 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '60b5fe96-982a-4e75-be6e-365e043c1cda'} Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:32:37.923054 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:32:37.924540 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:32:37.925862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:32:37.925862 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-27c053b7-50a7-4d70-abfe-da798604be57 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 404 len: 111 microversion: 2.1 time: 0.055487 Aug 17 20:32:37.927686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 571/1141] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:37 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:32:37.933788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-202ab50e-ab35-4504-ad4c-0f4ecc6a7542 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '.version_select at 0x7f23e1fc13a0>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:38.020291 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-202ab50e-ab35-4504-ad4c-0f4ecc6a7542 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072892658" status: 202 len: 0 microversion: 2.1 time: 0.090407 Aug 17 20:32:38.021220 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 571/1142] 10.222.0.64 () {58 vars in 1221 bytes} [Wed Aug 17 20:32:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2072892658 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:32:38.999753 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-2991592b-3724-4c6f-9a7a-657c63617a59 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: .version_select at 0x7f23e1ab1940>, body: {"keypair": {"name": "tempest-keypair-554262392", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIF3+w376q+tg/51x8G0ZuTNcI2axKMbF9+AnB9JJPdzZAfEI3Ahlnky38H4G0sgG79KyYC3qgfWnMXltdwjyzycDN9f2XG745BGnq0Cf5iBLOrVs7206jbE/0BPAOCj0Q=="}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:39.026583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-2991592b-3724-4c6f-9a7a-657c63617a59 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:32:39.034043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-2991592b-3724-4c6f-9a7a-657c63617a59 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'key_pairs'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:32:39.121708 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-2991592b-3724-4c6f-9a7a-657c63617a59 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125330 Aug 17 20:32:39.129000 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 572/1143] 10.222.0.64 () {60 vars in 1159 bytes} [Wed Aug 17 20:32:38 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:42.192662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-944629378", "imageRef": "1a9d4c43-d534-4e79-a64c-daded3250a64", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "31711876-3b7e-4c5a-9dfe-2ee7155c4a36"}], "security_groups": [{"name": "tempest-securitygroup--94450320"}], "key_name": "tempest-keypair-554262392", "user_data": "}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:42.336124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] validate_networks() for [('31711876-3b7e-4c5a-9dfe-2ee7155c4a36', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:32:42.801990 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:32:42.802392 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:32:42.803337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:32:42.803489 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:32:42.803968 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:32:42.813396 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:42.813926 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:42.814413 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:42.815333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:42.815828 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:42.816294 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:42.823566 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:42.835776 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:32:42.837923 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:42.840333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Getting quotas for user d3375fbaa62241cf83dd214b21d742b8 and project ce3c6f9ea3764773a663c1a67b1c5ae6. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:32:42.852680 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:32:42.855070 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='1a9d4c43-d534-4e79-a64c-daded3250a64',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:32:43.067202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ff8d862a-b46a-4d8c-81d2-aff81f9a5916 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.879373 Aug 17 20:32:43.067754 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 572/1144] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:32:42 2022] POST /compute/v2.1/servers => generated 400 bytes in 881 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:32:43.080497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-caa042b2-31ed-4aa7-aecb-bc3c3cc8269b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:43.081181 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-caa042b2-31ed-4aa7-aecb-bc3c3cc8269b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:43.084916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:43.138811 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-caa042b2-31ed-4aa7-aecb-bc3c3cc8269b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:43.146180 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-caa042b2-31ed-4aa7-aecb-bc3c3cc8269b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1240 microversion: 2.1 time: 0.070331 Aug 17 20:32:43.146794 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 573/1145] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:43 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:44.168819 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:44.169699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:44.177319 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:44.177810 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:44.178387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:44.179001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:44.179460 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:44.179886 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:44.243323 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:44.251791 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a4a13620-e292-4925-a68f-6643529fea3e tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1244 microversion: 2.1 time: 0.088347 Aug 17 20:32:44.252369 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 573/1146] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:44 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1244 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:44.878962 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:44.879869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:44.886115 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:44.886606 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:44.887061 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:44.887770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:44.888292 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:44.888712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:44.891646 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:44.916583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:32:45.275723 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:45.276554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:45.285843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:45.286362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:45.286838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:45.287558 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:45.288124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:45.288554 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:45.363212 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:45.371063 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8caecb7d-c0c5-433d-99fc-9dc477fcec9c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1292 microversion: 2.1 time: 0.101158 Aug 17 20:32:45.371636 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 574/1147] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:45 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:45.416068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-91bd32dd-e31a-48e6-9498-ed89541c12f5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "DELETE /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 204 len: 0 microversion: 2.1 time: 0.541409 Aug 17 20:32:45.416792 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 574/1148] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:32:44 2022] DELETE /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 0 bytes in 543 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:32:45.430144 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:45.430824 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:45.438147 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:45.438651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:45.439132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:45.439835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:45.440383 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:45.440822 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:45.580977 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:45.588919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6527e108-dd88-4de2-af4d-5cdd92fd0daa tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1576 microversion: 2.1 time: 0.162728 Aug 17 20:32:45.589508 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 575/1149] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:45 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:46.397908 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:46.398618 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:46.406161 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:46.406770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:46.407222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:46.412505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:46.412505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:46.412505 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:46.476874 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:46.484650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e5ccb47d-5244-40f5-ade5-d256d43993c8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1300 microversion: 2.1 time: 0.091563 Aug 17 20:32:46.485244 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 575/1150] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:46 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1300 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:46.610933 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:46.611548 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:46.618897 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:46.619387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:46.619829 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:46.620550 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:46.621036 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:46.621438 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:46.766505 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:46.776001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3c810342-59e7-4a0f-aa86-0cd2ab8fcb34 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1576 microversion: 2.1 time: 0.169494 Aug 17 20:32:46.776603 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 576/1151] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:46 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:47.505671 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:47.506278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:47.516381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:47.516869 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:47.517776 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:47.518490 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:47.519172 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:47.519595 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:47.589851 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:47.598306 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1df0b964-4e43-4bc2-a0c9-3b35c4f09b02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1298 microversion: 2.1 time: 0.096354 Aug 17 20:32:47.598917 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 576/1152] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:47 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1298 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:47.803290 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:47.804565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:47.813081 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:47.813569 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:47.814378 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:47.815529 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:47.815971 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:47.816401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:48.073386 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:48.082441 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dd82d604-9947-4ba9-891c-a54458957573 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1576 microversion: 2.1 time: 0.284032 Aug 17 20:32:48.084912 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 577/1153] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:47 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1576 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:48.621008 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:48.621698 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:48.628857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:48.629343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:48.629795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:48.630489 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:48.630967 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:48.631386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:48.843916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:48.854911 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-7f3195f8-8d3a-4b41-9f69-69abe9371541 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.238192 Aug 17 20:32:48.855503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 577/1154] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:48 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:49.110083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:49.110732 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:49.118510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:49.118510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:49.118936 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:49.119661 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:49.120092 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:49.120517 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:49.194797 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:49.204422 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3f5f896d-12de-4c2a-bd10-f507b6e2ed4d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1509 microversion: 2.1 time: 0.099766 Aug 17 20:32:49.204903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 578/1155] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:49 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1509 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:49.293062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-9ccf173c-b275-4aea-a464-8daf48f2d3aa req-4ab000c1-e282-4647-99d0-29f126da4675 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ca97cd-ad46-405d-8cfb-dc734e6523ab", "name": "network-vif-deleted", "tag": "51f057c9-2061-42dd-866a-0fcf5ff88d0b"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:49.304554 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9ccf173c-b275-4aea-a464-8daf48f2d3aa req-4ab000c1-e282-4647-99d0-29f126da4675 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:49.307397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9ccf173c-b275-4aea-a464-8daf48f2d3aa req-4ab000c1-e282-4647-99d0-29f126da4675 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:49.307397 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-9ccf173c-b275-4aea-a464-8daf48f2d3aa req-4ab000c1-e282-4647-99d0-29f126da4675 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:49.319116 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-9ccf173c-b275-4aea-a464-8daf48f2d3aa req-4ab000c1-e282-4647-99d0-29f126da4675 service nova] Creating event network-vif-deleted:51f057c9-2061-42dd-866a-0fcf5ff88d0b for instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab on hv-cinder-83538 Aug 17 20:32:49.324583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-9ccf173c-b275-4aea-a464-8daf48f2d3aa req-4ab000c1-e282-4647-99d0-29f126da4675 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035316 Aug 17 20:32:49.325310 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 578/1156] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:32:49.876921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:49.883196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:49.884199 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:49.884721 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:49.885174 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:49.885885 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:49.886393 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:49.886865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:50.074662 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:50.080410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4f5d5bfe-2703-426b-904c-dc57192f2042 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.207890 Aug 17 20:32:50.090725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 579/1157] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:49 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:50.251108 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:50.256219 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:50.274653 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:50.276014 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:50.277343 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:50.278964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:50.280630 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:50.284189 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:50.344758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:50.345252 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:50.345688 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:50.346141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lazy-loading 'fault' on Instance uuid 55ca97cd-ad46-405d-8cfb-dc734e6523ab {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:32:50.395972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:50.401888 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4675956e-c85c-4850-95d0-654ed301aaee tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 200 len: 1229 microversion: 2.1 time: 0.179185 Aug 17 20:32:50.402471 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 579/1158] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:50 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 1229 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:51.103126 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:51.103875 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:51.111444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:51.111943 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:51.112429 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:51.113741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:51.114159 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:51.114593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:51.254210 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:51.262317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e478536a-7132-4d33-8fa1-26de20a378d7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.163347 Aug 17 20:32:51.262939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 580/1159] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:51 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:51.342231 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-edfc6a65-be41-4d09-b075-0b7f2eff11a6 req-b648269b-b7f1-47aa-a6c2-4a30fd256d7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442d1e98-bb05-464c-bf8a-91863a1b348c", "tag": "45569de1-6d21-4266-8e33-237b0fc66558"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:51.352225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-edfc6a65-be41-4d09-b075-0b7f2eff11a6 req-b648269b-b7f1-47aa-a6c2-4a30fd256d7e service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:51.353079 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-edfc6a65-be41-4d09-b075-0b7f2eff11a6 req-b648269b-b7f1-47aa-a6c2-4a30fd256d7e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:51.353521 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-edfc6a65-be41-4d09-b075-0b7f2eff11a6 req-b648269b-b7f1-47aa-a6c2-4a30fd256d7e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:51.365947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-edfc6a65-be41-4d09-b075-0b7f2eff11a6 req-b648269b-b7f1-47aa-a6c2-4a30fd256d7e service nova] Creating event network-changed:45569de1-6d21-4266-8e33-237b0fc66558 for instance 442d1e98-bb05-464c-bf8a-91863a1b348c on hv-cinder-83538 Aug 17 20:32:51.371155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-edfc6a65-be41-4d09-b075-0b7f2eff11a6 req-b648269b-b7f1-47aa-a6c2-4a30fd256d7e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032806 Aug 17 20:32:51.371749 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 580/1160] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:51.425750 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:51.426380 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:51.432515 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:51.432997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:51.433436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:51.434141 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:51.434597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:51.435051 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:51.450583 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] HTTP exception thrown: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Request method failure captured: Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab HTTP/1.1 Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-9JD3XkNiVD8yy0wMGStnfE-r2w3oly2Yut6DXz4EuV5MgyS_VD-ciK7m-epFqFng3Yt8uOS1Fiy5zFxc0bAIYw850jFA-8JpPqFeKfOQPj-gDvH3n8nduVVTkdJjbkJWFSwoM2Y6zbKOnsgfDKEuQHPnG6q006XdqOipGWv6X1kU Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:32:51.453028 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-TestVolumeBootPattern-837355310 Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 79b37b77e3e44797b58ef9dd89747ca4 Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:32:51.462069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '55ca97cd-ad46-405d-8cfb-dc734e6523ab'} Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:32:51.463555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:32:51.465003 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:32:51.466150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Returning 404 to user: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:32:51.466150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2d16aa29-7fde-4e58-bb2a-2a46ebd8fcda tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 404 len: 111 microversion: 2.1 time: 0.032987 Aug 17 20:32:51.466150 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 581/1161] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:51 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:32:51.567286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1578591100", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-256203961", "security_groups": [{"name": "tempest-secgroup-smoke-603856003"}], "block_device_mapping_v2": [{"uuid": "29a09d63-16c3-44c6-baf2-c5bff519ed4b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a7b1ac9-3bf8-4b4f-bdc4-cfae427c64c1"}]}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:51.691145 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.network.neutron [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] validate_networks() for [('8a7b1ac9-3bf8-4b4f-bdc4-cfae427c64c1', None, None, None, None, None)] {{(pid=121276) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:32:52.202430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Flavor limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:32:52.202889 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Image limits 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:32:52.203366 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Flavor pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:32:52.203779 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Image pref 0:0:0 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:32:52.204190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.virt.hardware [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121276) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:32:52.213312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:52.213796 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:52.214230 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:52.214995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:52.215473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:52.215872 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:52.233957 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for project 62ed5118006d48e8a68f1f4506e54546. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:32:52.238103 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.quota [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for user 79b37b77e3e44797b58ef9dd89747ca4 and project 62ed5118006d48e8a68f1f4506e54546. Resources: {'ram', 'instances', 'cores'} {{(pid=121276) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:32:52.284747 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:52.285367 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:52.292214 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:52.292697 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:52.293332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:52.294177 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:52.294699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:52.295738 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:52.300947 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Going to run 1 instances... {{(pid=121276) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:32:52.303265 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='29a09d63-16c3-44c6-baf2-c5bff519ed4b',volume_size=None,volume_type=None)] {{(pid=121276) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:32:52.468918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:52.476807 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-13e47093-da66-4b79-903d-6012b71dc7c2 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.196308 Aug 17 20:32:52.477390 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 582/1162] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:52 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:52.898086 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [f7c7a371-8daa-4dd7-b854-db4bb1471a15] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:32:53.501140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:53.501701 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:53.503664 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:53.504363 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=6 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:32:53.509855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:53.510348 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:53.510818 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:53.511524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:53.511978 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:53.512405 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:53.658690 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:53.673336 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-cc816f18-14b3-4b12-8e1c-a3d09ef4dbe4 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.176069 Aug 17 20:32:53.674309 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 583/1163] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:53 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:53.907442 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [f7c7a371-8daa-4dd7-b854-db4bb1471a15] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 51870. Aug 17 20:32:53.912190 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b9e7f105-beae-4d13-9348-5600942ff0b7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.349231 Aug 17 20:32:53.913103 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 581/1164] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:32:51 2022] POST /compute/v2.1/servers => generated 405 bytes in 2351 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:32:53.925283 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8ea64efd-5d27-457a-93a3-00d82c4b3d26 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:53.926448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8ea64efd-5d27-457a-93a3-00d82c4b3d26 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:53.984283 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8ea64efd-5d27-457a-93a3-00d82c4b3d26 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:53.993195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8ea64efd-5d27-457a-93a3-00d82c4b3d26 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1094 microversion: 2.1 time: 0.072064 Aug 17 20:32:53.994069 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 584/1165] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:53 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:54.707751 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:54.715495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:54.715661 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:54.716019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:54.716486 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:54.717271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:54.717728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:54.718229 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:54.888199 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:54.896177 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d3b66a95-127f-4797-a169-18d1700797a7 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.193215 Aug 17 20:32:54.896785 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 582/1166] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:54 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:55.014590 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:55.015262 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:55.022510 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:55.023030 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:55.023472 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:55.024222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:55.024685 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:55.025118 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:55.089110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:55.097101 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-05a66f14-c0f0-4091-a73c-173015f5f426 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1144 microversion: 2.1 time: 0.086712 Aug 17 20:32:55.097619 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 585/1167] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:55 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:55.541315 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-08bb362c-0b33-449a-83e6-b9169363246b req-893823f3-459b-43e8-94af-d5d7f313b17f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442d1e98-bb05-464c-bf8a-91863a1b348c", "name": "network-vif-plugged", "status": "completed", "tag": "45569de1-6d21-4266-8e33-237b0fc66558"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:55.552307 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-08bb362c-0b33-449a-83e6-b9169363246b req-893823f3-459b-43e8-94af-d5d7f313b17f service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:55.552790 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-08bb362c-0b33-449a-83e6-b9169363246b req-893823f3-459b-43e8-94af-d5d7f313b17f service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:55.553226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-08bb362c-0b33-449a-83e6-b9169363246b req-893823f3-459b-43e8-94af-d5d7f313b17f service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:55.565237 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-08bb362c-0b33-449a-83e6-b9169363246b req-893823f3-459b-43e8-94af-d5d7f313b17f service nova] Creating event network-vif-plugged:45569de1-6d21-4266-8e33-237b0fc66558 for instance 442d1e98-bb05-464c-bf8a-91863a1b348c on hv-cinder-83538 Aug 17 20:32:55.570325 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-08bb362c-0b33-449a-83e6-b9169363246b req-893823f3-459b-43e8-94af-d5d7f313b17f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Aug 17 20:32:55.570968 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 583/1168] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:55.919207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:55.920783 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:55.927409 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:55.927898 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:55.928329 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:55.929055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:55.929501 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:55.929924 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:56.074399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:56.082454 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-25cbe3fe-c1f3-4b27-880a-3aa390e5b3b6 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.167378 Aug 17 20:32:56.093804 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 586/1169] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:55 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:56.120107 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:56.120789 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:56.127599 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:56.133944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:56.133944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:56.133944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:56.133944 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:56.134329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:56.200352 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:56.208821 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8fab3b7b-9886-4613-b8d1-b463e55e378e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1192 microversion: 2.1 time: 0.093635 Aug 17 20:32:56.209405 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 584/1170] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:56 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1192 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:57.104884 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:57.105598 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:57.112847 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:57.113333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:57.113790 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:57.114479 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:57.114962 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:57.115386 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:57.234511 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:57.235256 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:57.241901 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:57.248847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:57.248847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:57.248847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:57.248847 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:57.249423 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:57.266152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:57.274604 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a076d39c-6bd2-4026-83ca-90e9b6216c02 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1364 microversion: 2.1 time: 0.173884 Aug 17 20:32:57.275207 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 587/1171] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:57 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:57.314346 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:57.323585 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-552a9582-b369-4ed8-aac1-3bd3975d75d2 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1200 microversion: 2.1 time: 0.093079 Aug 17 20:32:57.324314 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 585/1172] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:57 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1200 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:32:58.296481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:58.297038 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:58.304202 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:58.304714 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:58.305162 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:58.305877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:58.306337 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:58.306798 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:58.348673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:58.349352 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:58.366454 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:58.366978 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:58.367677 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:58.368386 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:58.368844 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:58.369527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:58.508453 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:58.517928 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ee146e73-1de1-461d-94dd-603e9813e85c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1553 microversion: 2.1 time: 0.226354 Aug 17 20:32:58.521362 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 588/1173] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:58 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1553 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:58.539073 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:58.539580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:58.549678 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:58.550067 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:58.551087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:58.551087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:58.551753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:58.552274 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:58.552780 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:58.557513 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-6eadbf3b-8edb-42da-9d7b-e83ba70e9b1e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1277 microversion: 2.1 time: 0.212812 Aug 17 20:32:58.558222 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 586/1174] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:58 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1277 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:32:58.640328 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5ac4e436-36fa-4ab2-8092-3ae1e284ffca tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.105092 Aug 17 20:32:58.641042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 589/1175] 10.222.0.64 () {58 vars in 1275 bytes} [Wed Aug 17 20:32:58 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:32:59.207964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-6cc027c9-2c15-4ded-a883-4d5674931e1a req-79e63414-1bd5-46d7-8ff7-88d58d82f772 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab796b32-939e-41bb-8676-0bec10b2aa93", "tag": "956cf680-0d63-4294-b14a-3d2f42b56109"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:32:59.222939 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-6cc027c9-2c15-4ded-a883-4d5674931e1a req-79e63414-1bd5-46d7-8ff7-88d58d82f772 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:59.223741 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-6cc027c9-2c15-4ded-a883-4d5674931e1a req-79e63414-1bd5-46d7-8ff7-88d58d82f772 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:59.224183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-6cc027c9-2c15-4ded-a883-4d5674931e1a req-79e63414-1bd5-46d7-8ff7-88d58d82f772 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:59.235882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-6cc027c9-2c15-4ded-a883-4d5674931e1a req-79e63414-1bd5-46d7-8ff7-88d58d82f772 service nova] Creating event network-changed:956cf680-0d63-4294-b14a-3d2f42b56109 for instance ab796b32-939e-41bb-8676-0bec10b2aa93 on hv-cinder-83538 Aug 17 20:32:59.240834 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-6cc027c9-2c15-4ded-a883-4d5674931e1a req-79e63414-1bd5-46d7-8ff7-88d58d82f772 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042223 Aug 17 20:32:59.241628 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 587/1176] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:32:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:32:59.583182 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:32:59.584726 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:32:59.591580 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:59.592342 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:59.592949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:59.593672 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:32:59.594170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:32:59.594693 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:32:59.839522 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:32:59.849634 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-990f3716-4039-46fa-ab0b-329b073831b5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.271978 Aug 17 20:32:59.850235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 590/1177] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:32:59 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:00.359846 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-e6f98e98-6313-407a-b86a-bf2ab2b42fda req-f6a5b2d6-110e-4565-9404-97e64c7ea740 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "442d1e98-bb05-464c-bf8a-91863a1b348c", "tag": "45569de1-6d21-4266-8e33-237b0fc66558"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:33:00.370331 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e6f98e98-6313-407a-b86a-bf2ab2b42fda req-f6a5b2d6-110e-4565-9404-97e64c7ea740 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:00.370829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e6f98e98-6313-407a-b86a-bf2ab2b42fda req-f6a5b2d6-110e-4565-9404-97e64c7ea740 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:00.371256 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-e6f98e98-6313-407a-b86a-bf2ab2b42fda req-f6a5b2d6-110e-4565-9404-97e64c7ea740 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:00.383046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-e6f98e98-6313-407a-b86a-bf2ab2b42fda req-f6a5b2d6-110e-4565-9404-97e64c7ea740 service nova] Creating event network-changed:45569de1-6d21-4266-8e33-237b0fc66558 for instance 442d1e98-bb05-464c-bf8a-91863a1b348c on hv-cinder-83538 Aug 17 20:33:00.388044 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-e6f98e98-6313-407a-b86a-bf2ab2b42fda req-f6a5b2d6-110e-4565-9404-97e64c7ea740 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.180975 Aug 17 20:33:00.389517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 588/1178] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:33:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:33:00.872340 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:00.873223 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:00.884764 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:00.890121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:00.890121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:00.890121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:00.890121 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:00.891333 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:00.910820 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=100 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:01.050097 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:01.058614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-6d286e06-30a6-4d44-a0d7-d8406a600207 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.190162 Aug 17 20:33:01.070288 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 591/1179] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:00 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:33:02.082557 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:02.083412 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:02.090007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:02.090500 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:02.090974 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:02.092561 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:02.093023 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:02.093453 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:02.223973 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:02.237426 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:02.243607 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e8a29d9e-d835-476b-90e0-9cb0ca70275b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.165802 Aug 17 20:33:02.244104 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 589/1180] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:02 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:33:03.265375 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:03.265985 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:03.272910 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:03.273409 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:03.273850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:03.274565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:03.275055 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:03.275484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:03.418850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:03.426865 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d27b1d5c-6333-43b5-bd62-b2d1914fa26c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.165682 Aug 17 20:33:03.427449 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 592/1181] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:03 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:04.449053 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:04.449745 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:04.452650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=12 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:04.458399 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:04.458964 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:04.459413 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:04.465286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:04.465286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:04.465286 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:04.626401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:04.626401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-f3782063-6c4d-4f05-8763-f68f0eb03d22 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.180161 Aug 17 20:33:04.626401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 590/1182] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:04 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:05.650544 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:05.651195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:05.653221 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:05.659373 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:05.659873 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:05.660319 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:05.661080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:05.661566 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:05.661995 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:05.803497 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:05.811934 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-09773ea4-bdd9-4e1b-b504-c2eac79f53a7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.165280 Aug 17 20:33:05.812546 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 593/1183] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:05 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:06.835291 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:06.835946 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:06.843137 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:06.843625 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:06.844062 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:06.844759 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:06.845209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:06.845633 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:07.000916 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:07.008706 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1d9cae64-c3bc-4876-9a91-92793f945a4e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.179126 Aug 17 20:33:07.009288 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 591/1184] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:06 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:08.030478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:08.031167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:08.037803 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:08.038301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:08.038768 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:08.039495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:08.039958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:08.040448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:08.178334 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:08.187013 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-55cc8b5e-e732-4c9b-be20-c4d6fd919a63 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.160347 Aug 17 20:33:08.187602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 594/1185] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:08 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:09.209055 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:09.209674 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:09.216600 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:09.217102 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:09.217547 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:09.218285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:09.218768 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:09.219193 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:09.387088 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:09.389803 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:09.397271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a66510b3-50ee-4a7b-a829-8cba6d7ff378 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.192698 Aug 17 20:33:09.404251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 592/1186] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:09 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:10.423514 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:10.424579 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:10.433507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:10.434015 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:10.434456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:10.436679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:10.436679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:10.436921 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:10.578322 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:10.586438 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e6ffdc1f-bf71-4b81-9d45-541b5b8fb1d4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.170458 Aug 17 20:33:10.587044 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 595/1187] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:10 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:11.608899 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:11.609507 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:11.616396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:11.616866 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:11.617560 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:11.618251 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:11.618728 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:11.619144 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:11.755673 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-71170ff7-7f25-4bbc-8c2c-6db8154c7576 req-22c6b3de-d16f-4b74-a0cb-a84f076fa218 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab796b32-939e-41bb-8676-0bec10b2aa93", "name": "network-vif-plugged", "status": "completed", "tag": "956cf680-0d63-4294-b14a-3d2f42b56109"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:33:11.768143 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-71170ff7-7f25-4bbc-8c2c-6db8154c7576 req-22c6b3de-d16f-4b74-a0cb-a84f076fa218 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:11.768842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-71170ff7-7f25-4bbc-8c2c-6db8154c7576 req-22c6b3de-d16f-4b74-a0cb-a84f076fa218 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:11.769195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-71170ff7-7f25-4bbc-8c2c-6db8154c7576 req-22c6b3de-d16f-4b74-a0cb-a84f076fa218 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:11.771667 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:11.779837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-0d029020-b221-47fe-a807-3a2a3901ebb6 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.175750 Aug 17 20:33:11.780429 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 593/1188] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:11 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:11.781600 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-71170ff7-7f25-4bbc-8c2c-6db8154c7576 req-22c6b3de-d16f-4b74-a0cb-a84f076fa218 service nova] Creating event network-vif-plugged:956cf680-0d63-4294-b14a-3d2f42b56109 for instance ab796b32-939e-41bb-8676-0bec10b2aa93 on hv-cinder-83538 Aug 17 20:33:11.787710 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-71170ff7-7f25-4bbc-8c2c-6db8154c7576 req-22c6b3de-d16f-4b74-a0cb-a84f076fa218 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036071 Aug 17 20:33:11.789124 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 596/1189] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:33:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 17 20:33:12.801835 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:12.802485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:12.808950 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:12.809553 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:12.810654 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:12.811365 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:12.811817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:12.812244 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:12.955830 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:12.963498 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3076dee3-126e-4413-998e-2484913e9899 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.165626 Aug 17 20:33:12.964276 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 594/1190] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:12 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:13.985687 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:13.986366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:13.992946 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:13.993431 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:13.993903 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:13.994599 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:13.995078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:13.995507 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:14.143527 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:14.152354 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d0ff6ef6-6e72-4bfe-8deb-133ac2573f7c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1265 microversion: 2.1 time: 0.171762 Aug 17 20:33:14.152931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 597/1191] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:13 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:15.175820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:15.176443 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:15.182882 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:15.183360 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:15.184076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:15.184604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:15.185705 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:15.186476 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:15.339072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:15.347587 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dec6c9d8-bce7-4dd0-a38f-f7bdcd103523 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1452 microversion: 2.1 time: 0.176347 Aug 17 20:33:15.348192 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 595/1192] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:15 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1452 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:15.369401 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:15.370026 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:15.376958 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:15.377500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:15.377948 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:15.378679 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:15.379142 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:15.379568 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:15.520438 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:15.528600 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-7833ac09-bbac-46cc-a5f5-3e4176231910 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1452 microversion: 2.1 time: 0.163295 Aug 17 20:33:15.529226 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 598/1193] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:15 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1452 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:17.598805 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-136d28a1-237a-4399-9a4a-695fdb2d01cc req-e6fc60d6-4680-4607-82e9-5873477bbf9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab796b32-939e-41bb-8676-0bec10b2aa93", "tag": "956cf680-0d63-4294-b14a-3d2f42b56109"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:33:17.604250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:17.610644 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-136d28a1-237a-4399-9a4a-695fdb2d01cc req-e6fc60d6-4680-4607-82e9-5873477bbf9d service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:17.611085 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-136d28a1-237a-4399-9a4a-695fdb2d01cc req-e6fc60d6-4680-4607-82e9-5873477bbf9d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:17.611514 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-136d28a1-237a-4399-9a4a-695fdb2d01cc req-e6fc60d6-4680-4607-82e9-5873477bbf9d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:17.624396 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-136d28a1-237a-4399-9a4a-695fdb2d01cc req-e6fc60d6-4680-4607-82e9-5873477bbf9d service nova] Creating event network-changed:956cf680-0d63-4294-b14a-3d2f42b56109 for instance ab796b32-939e-41bb-8676-0bec10b2aa93 on hv-cinder-83538 Aug 17 20:33:17.630704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-136d28a1-237a-4399-9a4a-695fdb2d01cc req-e6fc60d6-4680-4607-82e9-5873477bbf9d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035136 Aug 17 20:33:17.631550 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 596/1194] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:33:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:33:36.470974 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:36.471638 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:36.474208 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:36.474900 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=41 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:36.479543 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:36.484692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:36.484692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:36.484692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:36.484692 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:36.485264 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:36.506421 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-3c1e06ab-f79e-4359-8565-746c89bf9759 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/ips" status: 200 len: 149 microversion: 2.1 time: 0.039478 Aug 17 20:33:36.507017 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 599/1195] 10.222.0.64 () {58 vars in 1248 bytes} [Wed Aug 17 20:33:36 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:33:38.244312 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e38b6e67-c063-47cf-ad71-da9cf3bf95a6"}} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:33:38.249198 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:38.249796 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=21 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:33:38.255250 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:38.255733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:38.256169 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:38.256889 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:38.257398 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:38.257849 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:39.301793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-64a700dd-2e4d-4a72-bb6a-15aa7f0bcbaf tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "POST /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.062492 Aug 17 20:33:39.302995 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 597/1196] 10.222.0.64 () {60 vars in 1323 bytes} [Wed Aug 17 20:33:38 2022] POST /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments => generated 194 bytes in 1065 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:33:48.022612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:48.023361 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:48.031699 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:48.035837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:48.035837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:48.035837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:48.035837 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:48.036237 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:48.122285 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lazy-loading 'services' on Instance uuid 442d1e98-bb05-464c-bf8a-91863a1b348c {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:33:48.405156 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-44771e26-cdf6-471f-b22d-503b76d0f631 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments/e38b6e67-c063-47cf-ad71-da9cf3bf95a6" status: 202 len: 0 microversion: 2.1 time: 0.386464 Aug 17 20:33:48.405788 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 600/1197] 10.222.0.64 () {58 vars in 1416 bytes} [Wed Aug 17 20:33:48 2022] DELETE /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments/e38b6e67-c063-47cf-ad71-da9cf3bf95a6 => generated 0 bytes in 388 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:33:48.416124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:48.419261 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:48.427169 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:48.427169 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:48.427765 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:48.428482 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:48.428938 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:48.429368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:48.465108 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4731216a-d646-4bce-ab59-63afcdd06272 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054385 Aug 17 20:33:48.465531 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 598/1198] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:33:48 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:33:49.478702 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:49.481316 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:49.487707 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:49.488203 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:49.488641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:49.489338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:49.489799 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:49.490225 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:49.521793 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-988d7654-c2c1-402c-ad12-da11ea4cf10f tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047864 Aug 17 20:33:49.522297 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 601/1199] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:33:49 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:33:50.534245 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:50.536448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:50.543537 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:50.544293 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:50.544875 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:50.545570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:50.546019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:50.546440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:50.576414 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-51644d02-acc4-4fbc-ab02-c19b607fe8d8 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046156 Aug 17 20:33:50.576972 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 599/1200] 10.222.0.64 () {58 vars in 1302 bytes} [Wed Aug 17 20:33:50 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 17 20:33:50.639643 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:50.640238 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:50.646597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:50.647110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:50.647549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:50.648240 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:50.648696 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:50.649123 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:50.676339 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:33:51.033834 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2e865cbf-29bf-45b0-84af-2e10f4449d30 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 204 len: 0 microversion: 2.1 time: 0.397841 Aug 17 20:33:51.034415 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 602/1201] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:33:50 2022] DELETE /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:33:51.043584 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:51.044204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:51.050415 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:51.050935 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:51.051457 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:51.052154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:51.052604 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:51.053028 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:51.201503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:51.211655 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-c53a9f6e-465b-4f65-a7bc-e8cf61afa81b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1678 microversion: 2.1 time: 0.172550 Aug 17 20:33:51.212449 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 600/1202] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:51 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:52.252300 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:52.253000 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:52.259753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:52.260234 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:52.260675 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:52.261370 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:52.261855 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:52.262273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:52.406532 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:52.414232 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-62313d9c-59ec-485e-a67d-c11ea2c7a691 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1678 microversion: 2.1 time: 0.166229 Aug 17 20:33:52.414833 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 603/1203] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:52 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1678 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:53.436903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:53.437566 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:53.443966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:53.444448 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:53.444902 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:53.445602 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:53.446045 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:53.446462 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:53.583400 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:53.592035 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-b0d0c3f4-456b-4add-95a7-cc57b3deea77 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1678 microversion: 2.1 time: 0.159467 Aug 17 20:33:53.592618 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 601/1204] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:53 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:54.298335 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-0197774f-8233-4a78-a8b4-2594c46777dd req-d9c4913a-b9d6-4ab5-876a-5bc14b62954d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "442d1e98-bb05-464c-bf8a-91863a1b348c", "name": "network-vif-deleted", "tag": "45569de1-6d21-4266-8e33-237b0fc66558"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:33:54.310014 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-0197774f-8233-4a78-a8b4-2594c46777dd req-d9c4913a-b9d6-4ab5-876a-5bc14b62954d service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:54.312428 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-0197774f-8233-4a78-a8b4-2594c46777dd req-d9c4913a-b9d6-4ab5-876a-5bc14b62954d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:54.312428 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-0197774f-8233-4a78-a8b4-2594c46777dd req-d9c4913a-b9d6-4ab5-876a-5bc14b62954d service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:54.322872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-0197774f-8233-4a78-a8b4-2594c46777dd req-d9c4913a-b9d6-4ab5-876a-5bc14b62954d service nova] Creating event network-vif-deleted:45569de1-6d21-4266-8e33-237b0fc66558 for instance 442d1e98-bb05-464c-bf8a-91863a1b348c on hv-cinder-83538 Aug 17 20:33:54.328376 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-0197774f-8233-4a78-a8b4-2594c46777dd req-d9c4913a-b9d6-4ab5-876a-5bc14b62954d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033613 Aug 17 20:33:54.328905 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 604/1205] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:33:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:33:54.732377 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:54.733780 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:54.740519 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:54.741034 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:54.741873 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:54.742719 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:54.743173 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:54.743597 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:54.778246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:54.778771 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:54.779207 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:54.779704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lazy-loading 'fault' on Instance uuid 442d1e98-bb05-464c-bf8a-91863a1b348c {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:33:54.826694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3375fbaa62241cf83dd214b21d742b8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3c6f9ea3764773a663c1a67b1c5ae6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:33:54.835046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d369ce02-a1da-4379-840d-514da85b5036 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 200 len: 1330 microversion: 2.1 time: 0.225182 Aug 17 20:33:54.838777 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 602/1206] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:54 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 1330 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:33:55.858721 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:55.859425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:55.865651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:55.866133 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:55.866872 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:55.867565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:55.868019 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:55.868479 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:55.884374 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c HTTP/1.1 Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:33:55.886009 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:55.887688 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '442d1e98-bb05-464c-bf8a-91863a1b348c'} Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:33:55.888597 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:55.890167 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:55.891592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:33:55.891592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-afc9643e-87be-4dec-b010-f747970ce1fd tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 404 len: 111 microversion: 2.1 time: 0.034029 Aug 17 20:33:55.891592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 605/1207] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:55 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:33:55.896817 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-038a1e05-a050-4a7b-9ace-0f16ee4057dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '.version_select at 0x7f23e1ab1700>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:55.986503 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-038a1e05-a050-4a7b-9ace-0f16ee4057dc tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-554262392" status: 202 len: 0 microversion: 2.1 time: 0.093471 Aug 17 20:33:55.987123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 603/1208] 10.222.0.64 () {58 vars in 1218 bytes} [Wed Aug 17 20:33:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-554262392 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:33:58.113802 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:58.114286 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:58.121104 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:58.121584 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:58.122057 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:58.122741 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:58.123195 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:58.123621 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:58.137661 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c HTTP/1.1 Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:33:58.139235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.140893 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '442d1e98-bb05-464c-bf8a-91863a1b348c'} Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:33:58.141781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.147851 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.149103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:33:58.149103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d869f8f2-d263-4bdc-b974-f7579bca4d4c tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 404 len: 111 microversion: 2.1 time: 0.030667 Aug 17 20:33:58.149103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 606/1209] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:33:58 2022] DELETE /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:33:58.155527 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:58.156143 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 442d1e98-bb05-464c-bf8a-91863a1b348c] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:58.162774 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:58.163277 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:58.163710 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:58.164403 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:58.164856 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:58.165278 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:58.178274 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c HTTP/1.1 Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:33:58.179951 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.182468 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '442d1e98-bb05-464c-bf8a-91863a1b348c'} Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:33:58.184226 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. Aug 17 20:33:58.185857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:58.187198 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 442d1e98-bb05-464c-bf8a-91863a1b348c could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:33:58.187198 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-e3616d29-6160-4d44-b04b-3d7cc7f99cc5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c" status: 404 len: 111 microversion: 2.1 time: 0.030834 Aug 17 20:33:58.187198 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 604/1210] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:58 2022] GET /compute/v2.1/servers/442d1e98-bb05-464c-bf8a-91863a1b348c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:33:59.475976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:59.476463 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:59.482677 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.483166 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.483606 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.484302 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.484758 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.485183 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.498902 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda HTTP/1.1 Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:33:59.500484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.502043 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '60b5fe96-982a-4e75-be6e-365e043c1cda'} Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:33:59.502901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.504317 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.505891 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:33:59.505891 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2571c2d5-2abc-41c2-9638-94cd63fdad85 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 404 len: 111 microversion: 2.1 time: 0.030263 Aug 17 20:33:59.505891 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 607/1211] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:33:59 2022] DELETE /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:33:59.510578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:59.511733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 60b5fe96-982a-4e75-be6e-365e043c1cda] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:59.518673 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.519155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.519585 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.520281 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.520711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.521129 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.535330 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda HTTP/1.1 Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:33:59.536820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.538369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '60b5fe96-982a-4e75-be6e-365e043c1cda'} Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:33:59.539329 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. Aug 17 20:33:59.540838 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.542109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 60b5fe96-982a-4e75-be6e-365e043c1cda could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:33:59.542109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-000c7fec-87a5-47de-8200-b774be1793a9 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda" status: 404 len: 111 microversion: 2.1 time: 0.031600 Aug 17 20:33:59.542109 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 605/1212] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:59 2022] GET /compute/v2.1/servers/60b5fe96-982a-4e75-be6e-365e043c1cda => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:33:59.546890 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:59.547397 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:59.553425 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.553979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.554427 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.555153 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.555614 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.556040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.569656 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 HTTP/1.1 Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:33:59.571276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.572838 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '0e7994a9-636a-40a4-8034-ec4dd4c23049'} Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:33:59.574229 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.576007 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.577444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:33:59.577444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e5d84304-fb93-4c14-9f59-f8b16c844b61 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 404 len: 111 microversion: 2.1 time: 0.029934 Aug 17 20:33:59.577444 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 608/1213] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:33:59 2022] DELETE /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:33:59.582019 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:33:59.582640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: 0e7994a9-636a-40a4-8034-ec4dd4c23049] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:33:59.588878 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.589368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.590430 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.591155 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:33:59.591611 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:33:59.592072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:33:59.605725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 HTTP/1.1 Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:33:59.607285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.609370 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '0e7994a9-636a-40a4-8034-ec4dd4c23049'} Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:33:59.610523 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. Aug 17 20:33:59.611980 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:33:59.613235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance 0e7994a9-636a-40a4-8034-ec4dd4c23049 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:33:59.613235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-636045e5-3683-42c9-8256-adbe132492d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049" status: 404 len: 111 microversion: 2.1 time: 0.030585 Aug 17 20:33:59.613235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 606/1214] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:33:59 2022] GET /compute/v2.1/servers/0e7994a9-636a-40a4-8034-ec4dd4c23049 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:34:00.966481 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:34:00.967020 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:34:00.973433 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:34:00.973919 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:34:00.974355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:34:00.975088 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:34:00.975545 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:34:00.975972 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:34:00.989625 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 HTTP/1.1 Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:34:00.991555 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:00.993140 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': 'c9caaec6-d09c-42fe-a068-150f69501964'} Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:34:00.994132 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:00.995852 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:34:00.997628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:34:00.997628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-e4ac4dd1-3fc7-4cff-9029-cc77cb12e3d5 tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 404 len: 111 microversion: 2.1 time: 0.031082 Aug 17 20:34:00.997628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 609/1215] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:34:00 2022] DELETE /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:34:01.002669 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:34:01.003313 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] [instance: c9caaec6-d09c-42fe-a068-150f69501964] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:34:01.009715 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:34:01.010189 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:34:01.010617 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:34:01.012076 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:34:01.012582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:34:01.013004 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:34:01.029262 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] HTTP exception thrown: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Request method failure captured: Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 HTTP/1.1 Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-FBEEmD_kICquiqlmXFTt5qOcgsGyiT9u3m1oAx2dTOL3HeU0a1xthQfNu1Q-Ddhfqf-9x_O_FCLvfgyoAjDYDExXpQIeAOENwIgkDfAeYfNBgW_y6FMbfkYxYxuIYR3WBxGL4UxWcCl5jhacyLMdgkxLFoBjGs8Qz2rw49RCoV-A Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:34:01.030841 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_ce3c6f9ea3764773a663c1a67b1c5ae6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: ce3c6f9ea3764773a663c1a67b1c5ae6 Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1256207060 Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: d3375fbaa62241cf83dd214b21d742b8 Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-AttachVolumeNegativeTest-1256207060-project Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:01.032495 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': 'c9caaec6-d09c-42fe-a068-150f69501964'} Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:34:01.033682 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. Aug 17 20:34:01.035297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:34:01.036685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] Returning 404 to user: Instance c9caaec6-d09c-42fe-a068-150f69501964 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:34:01.036685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-750215ae-11e6-48f0-9742-c554321eef9b tempest-AttachVolumeNegativeTest-1256207060 tempest-AttachVolumeNegativeTest-1256207060-project] 10.222.0.64 "GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964" status: 404 len: 111 microversion: 2.1 time: 0.033678 Aug 17 20:34:01.036685 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 607/1216] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:34:00 2022] GET /compute/v2.1/servers/c9caaec6-d09c-42fe-a068-150f69501964 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:35:04.769823 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:35:04.770387 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Wed Aug 17 20:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:35:16.862222 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:16.863049 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=51,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:16.867372 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1935063119", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-256203961", "security_groups": [{"name": "tempest-secgroup-smoke-603856003"}], "block_device_mapping_v2": [{"uuid": "3e35e17e-94a2-4802-a7bc-f33cdb47b452", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "8a7b1ac9-3bf8-4b4f-bdc4-cfae427c64c1"}]}} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:35:16.988470 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.network.neutron [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] validate_networks() for [('8a7b1ac9-3bf8-4b4f-bdc4-cfae427c64c1', None, None, None, None, None)] {{(pid=121275) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 17 20:35:17.519410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Flavor limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 17 20:35:17.519987 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Image limits 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 17 20:35:17.520565 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Flavor pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 17 20:35:17.521042 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Image pref 0:0:0 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 17 20:35:17.521525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.virt.hardware [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121275) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 17 20:35:17.532338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:17.532914 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:17.533393 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:17.534176 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:17.534666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:17.535087 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:17.552789 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for project 62ed5118006d48e8a68f1f4506e54546. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 17 20:35:17.556939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.quota [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Getting quotas for user 79b37b77e3e44797b58ef9dd89747ca4 and project 62ed5118006d48e8a68f1f4506e54546. Resources: {'ram', 'instances', 'cores'} {{(pid=121275) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 17 20:35:17.617862 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Going to run 1 instances... {{(pid=121275) _provision_instances /opt/stack/nova/nova/compute/api.py:1391}} Aug 17 20:35:17.620038 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3e35e17e-94a2-4802-a7bc-f33cdb47b452',volume_size=None,volume_type=None)] {{(pid=121275) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1809}} Aug 17 20:35:18.185651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-452cd823-bf54-4356-aa34-45113e991baf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.325379 Aug 17 20:35:18.186299 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 610/1217] 10.222.0.64 () {60 vars in 1147 bytes} [Wed Aug 17 20:35:16 2022] POST /compute/v2.1/servers => generated 405 bytes in 1327 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 17 20:35:18.195480 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:18.196328 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:18.200640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-69eaf9ee-4580-4807-af34-73532ee69f4a tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:18.201257 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-69eaf9ee-4580-4807-af34-73532ee69f4a tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:18.262818 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-69eaf9ee-4580-4807-af34-73532ee69f4a tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:18.270997 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-69eaf9ee-4580-4807-af34-73532ee69f4a tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1094 microversion: 2.1 time: 0.077552 Aug 17 20:35:18.271813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 608/1218] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:18 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1094 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 17 20:35:19.294751 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:19.296018 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:19.303191 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:19.303728 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:19.304680 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:19.304931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:19.305395 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:19.305925 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:19.373548 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:19.381110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-8cd7785e-b2b8-42d8-8c65-b4d8129a5e6e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1144 microversion: 2.1 time: 0.090713 Aug 17 20:35:19.381686 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 611/1219] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:19 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1144 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:20.403725 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:20.411366 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:20.420258 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:20.420748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:20.421214 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:20.421926 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:20.422381 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:20.425335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:20.513068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:20.520565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-a48e64e3-3d75-4ab5-afa4-fcf5451bfdf9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1192 microversion: 2.1 time: 0.123029 Aug 17 20:35:20.525941 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 609/1220] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:20 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1192 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:21.541332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:21.541952 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:21.549061 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:21.549593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:21.550117 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:21.550812 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:21.551280 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:21.551753 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:21.621907 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:21.630276 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-d89c0628-db3d-4ace-8fee-ff15e5527f9b tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1210 microversion: 2.1 time: 0.092777 Aug 17 20:35:21.631341 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 612/1221] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:21 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:22.657586 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:22.658235 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:22.665970 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:22.666455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:22.666931 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:22.667636 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:22.668848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:22.672522 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:22.810296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:22.818186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-31b6b554-276e-4bb1-bd2a-71ea23147fe7 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1277 microversion: 2.1 time: 0.164243 Aug 17 20:35:22.818541 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 610/1222] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:22 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1277 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:23.049835 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-17410650-269d-40e0-b301-0108432d64d6 req-0111b07a-36b0-4f00-8b17-a0f798d34d36 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8873261-5f52-47b2-9346-b1d84ab01fea", "tag": "c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:35:23.060040 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-17410650-269d-40e0-b301-0108432d64d6 req-0111b07a-36b0-4f00-8b17-a0f798d34d36 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:23.060514 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-17410650-269d-40e0-b301-0108432d64d6 req-0111b07a-36b0-4f00-8b17-a0f798d34d36 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:23.060938 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-17410650-269d-40e0-b301-0108432d64d6 req-0111b07a-36b0-4f00-8b17-a0f798d34d36 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:23.071984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-17410650-269d-40e0-b301-0108432d64d6 req-0111b07a-36b0-4f00-8b17-a0f798d34d36 service nova] Creating event network-changed:c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8 for instance c8873261-5f52-47b2-9346-b1d84ab01fea on hv-cinder-83538 Aug 17 20:35:23.077882 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-17410650-269d-40e0-b301-0108432d64d6 req-0111b07a-36b0-4f00-8b17-a0f798d34d36 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031755 Aug 17 20:35:23.078666 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 613/1223] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:35:23.839067 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:23.840829 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:23.848369 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:23.848914 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:23.849583 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:23.850764 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:23.851437 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:23.852098 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:24.002074 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:24.010095 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-dc4fb79a-957b-4543-a906-3de8e66f2a73 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.175682 Aug 17 20:35:24.010912 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 611/1224] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:23 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:25.034279 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:25.035058 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:25.041593 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:25.042080 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:25.042525 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:25.043984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:25.044544 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:25.044980 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:25.180289 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:25.187949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ac78e17e-4494-4842-9921-3faa311c8729 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.158365 Aug 17 20:35:25.188512 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 614/1225] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:25 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:26.209166 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:26.209756 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:26.216868 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:26.217355 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:26.217793 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:26.218485 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:26.218975 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:26.219401 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:26.358894 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:26.367141 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d4da544f-c796-4a22-b5b2-9d2ef412a572 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.161896 Aug 17 20:35:26.367699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 612/1226] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:26 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:27.388487 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:27.389103 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:27.395418 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:27.395896 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:27.396331 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:27.397013 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:27.397456 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:27.397904 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:27.538989 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:27.542500 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=2 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:27.547151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-aaa5aa6c-075f-40d2-a31c-6106416ce307 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.163411 Aug 17 20:35:27.547725 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 615/1227] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:27 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:28.575879 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:28.576464 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:28.578881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell0:SELECT=2 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:28.583637 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:28.584287 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:28.584582 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:28.585297 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:28.585748 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:28.586164 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:28.722368 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:28.730068 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-d76bdb13-5dbb-4915-a8b2-fe3b2fe49cad tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.158676 Aug 17 20:35:28.732758 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 613/1228] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:28 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:29.752090 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:29.752695 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:29.754901 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell0:SELECT=6 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:35:29.760402 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:29.760895 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:29.761332 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:29.762078 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:29.762526 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:29.762984 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:29.900850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:29.908570 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-4781ef2a-f032-4809-be39-79243eb78de1 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.160393 Aug 17 20:35:29.909138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 616/1229] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:29 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:30.929812 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:30.930440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:30.938168 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:30.938686 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:30.939124 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:30.939816 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:30.940271 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:30.940722 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:31.077465 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:31.085295 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3c0da8fe-c3bf-4823-8e18-278c98a3a3f9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.159505 Aug 17 20:35:31.085857 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 614/1230] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:30 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:32.107258 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:32.107883 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:32.114950 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:32.118806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:32.118806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:32.118806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:32.118806 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:32.119225 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:32.259945 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:32.269560 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ab6902cb-84e1-4605-bece-b6b184e54aa4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.167111 Aug 17 20:35:32.270243 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 617/1231] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:32 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:33.290230 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:33.290978 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:33.298852 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:33.299463 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:33.299966 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:33.300731 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:33.301184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:33.301599 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:33.440012 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:33.447659 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-1e53b515-5447-438c-afe0-aeb171a663a0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.161443 Aug 17 20:35:33.448221 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 615/1232] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:33 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:34.170698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-7fff17a9-eb20-4ece-b26e-7ea0432a6a30 req-089bdd7e-d95f-4aa0-b49b-ce5da22e72e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8873261-5f52-47b2-9346-b1d84ab01fea", "name": "network-vif-plugged", "status": "completed", "tag": "c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:35:34.180756 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-7fff17a9-eb20-4ece-b26e-7ea0432a6a30 req-089bdd7e-d95f-4aa0-b49b-ce5da22e72e2 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:34.181273 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-7fff17a9-eb20-4ece-b26e-7ea0432a6a30 req-089bdd7e-d95f-4aa0-b49b-ce5da22e72e2 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:34.181698 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-7fff17a9-eb20-4ece-b26e-7ea0432a6a30 req-089bdd7e-d95f-4aa0-b49b-ce5da22e72e2 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:34.193828 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-7fff17a9-eb20-4ece-b26e-7ea0432a6a30 req-089bdd7e-d95f-4aa0-b49b-ce5da22e72e2 service nova] Creating event network-vif-plugged:c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8 for instance c8873261-5f52-47b2-9346-b1d84ab01fea on hv-cinder-83538 Aug 17 20:35:34.199628 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-7fff17a9-eb20-4ece-b26e-7ea0432a6a30 req-089bdd7e-d95f-4aa0-b49b-ce5da22e72e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032211 Aug 17 20:35:34.200524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 618/1233] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:35:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:35:34.468209 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:34.468820 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:34.475645 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:34.476138 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:34.476615 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:34.477311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:34.477761 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:34.478215 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:34.612335 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:34.621810 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-537e33b6-039a-4b0f-b42a-45d2d9589555 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.156925 Aug 17 20:35:34.622440 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 616/1234] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:34 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:35.644301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:35.645004 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:35.651520 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:35.652235 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:35.652694 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:35.653488 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:35.653949 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:35.654377 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:35.790381 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:35.798410 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-9c41d8ad-e814-4f31-b5bb-3613c01b2f0e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1265 microversion: 2.1 time: 0.158866 Aug 17 20:35:35.798995 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 619/1235] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:35 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:36.819455 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:36.820056 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:36.827265 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:36.827742 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:36.828174 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:36.828867 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:36.829311 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:36.829732 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:36.962592 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:36.970565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-460f1aa9-f766-48a8-9d1d-d01089282e3f tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1451 microversion: 2.1 time: 0.154966 Aug 17 20:35:36.971154 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 617/1236] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:36 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:36.991084 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:35:36.996416 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:35:36.999312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:36.999823 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:37.000270 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:37.000976 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:37.001436 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:37.001864 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:37.140736 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:35:37.148349 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-46ccc446-ab77-4173-ae4b-8562bd0cc621 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1451 microversion: 2.1 time: 0.161446 Aug 17 20:35:37.151275 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 620/1237] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:35:36 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:35:39.455650 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-f936ac0f-d995-4d78-a703-bb54b95971ec req-3e430443-cf6e-4020-a033-ab98fe88d70b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8873261-5f52-47b2-9346-b1d84ab01fea", "tag": "c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:35:39.467670 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-f936ac0f-d995-4d78-a703-bb54b95971ec req-3e430443-cf6e-4020-a033-ab98fe88d70b service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:35:39.468295 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-f936ac0f-d995-4d78-a703-bb54b95971ec req-3e430443-cf6e-4020-a033-ab98fe88d70b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:35:39.468795 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-f936ac0f-d995-4d78-a703-bb54b95971ec req-3e430443-cf6e-4020-a033-ab98fe88d70b service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:35:39.482072 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-f936ac0f-d995-4d78-a703-bb54b95971ec req-3e430443-cf6e-4020-a033-ab98fe88d70b service nova] Creating event network-changed:c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8 for instance c8873261-5f52-47b2-9346-b1d84ab01fea on hv-cinder-83538 Aug 17 20:35:39.487840 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-f936ac0f-d995-4d78-a703-bb54b95971ec req-3e430443-cf6e-4020-a033-ab98fe88d70b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036709 Aug 17 20:35:39.488439 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 618/1238] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:36:33.148489 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:36:33.149205 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Wed Aug 17 20:36:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:37:23.453474 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:23.454613 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR oslo.messaging._drivers.impl_rabbit [-] [2b1986a3-a4e2-4c52-8820-5a4c9f1d1b96] AMQP server on 10.222.0.64:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Aug 17 20:37:23.455358 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG dbcounter [-] [121275] Writing DB stats nova_cell1:SELECT=54 {{(pid=121275) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:23.456733 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_api:SELECT=24 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:23.458123 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG dbcounter [-] [121276] Writing DB stats nova_cell1:SELECT=56 {{(pid=121276) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 17 20:37:23.460130 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:23.461060 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:23.463185 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-8f2c17dc-f854-47e4-bde4-d5494037f4b2 req-cc9b941c-6499-49e5-a303-639086d6d750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8873261-5f52-47b2-9346-b1d84ab01fea", "tag": "c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:37:23.469906 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:23.470312 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:23.470850 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:23.471795 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:23.473110 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:23.473328 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8f2c17dc-f854-47e4-bde4-d5494037f4b2 req-cc9b941c-6499-49e5-a303-639086d6d750 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:23.473542 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:23.473679 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8f2c17dc-f854-47e4-bde4-d5494037f4b2 req-cc9b941c-6499-49e5-a303-639086d6d750 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:23.474051 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-8f2c17dc-f854-47e4-bde4-d5494037f4b2 req-cc9b941c-6499-49e5-a303-639086d6d750 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:23.489028 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-8f2c17dc-f854-47e4-bde4-d5494037f4b2 req-cc9b941c-6499-49e5-a303-639086d6d750 service nova] Creating event network-changed:c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8 for instance c8873261-5f52-47b2-9346-b1d84ab01fea on hv-cinder-83538 Aug 17 20:37:23.496279 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-8f2c17dc-f854-47e4-bde4-d5494037f4b2 req-cc9b941c-6499-49e5-a303-639086d6d750 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045265 Aug 17 20:37:23.497747 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 619/1239] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:37:23.520485 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Going to try to terminate instance {{(pid=121275) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:37:23.883261 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-53292025-0d9d-46d3-be3e-2a020dc7be30 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "DELETE /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 204 len: 0 microversion: 2.1 time: 0.437404 Aug 17 20:37:23.884338 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 621/1240] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:37:23 2022] DELETE /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:37:23.893720 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:23.894723 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:23.902041 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:23.904407 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:23.905011 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:23.905676 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:23.905934 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:23.906372 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:24.160735 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:24.168570 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3d86468c-9e71-457b-bb5d-6202cb6d805c tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1576 microversion: 2.1 time: 0.279577 Aug 17 20:37:24.169184 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 620/1241] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:23 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1576 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:25.190170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:25.190981 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:25.197495 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:25.197982 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:25.198419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:25.199151 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:25.199612 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:25.200533 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:25.634083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:25.642439 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-0c550c53-958f-4d48-a9c9-9b97766e7ff5 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1576 microversion: 2.1 time: 0.456475 Aug 17 20:37:25.643058 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 622/1242] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:25 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1576 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:26.667544 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:26.668188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:26.678188 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:26.678712 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:26.679140 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:26.679848 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:26.680296 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:26.680730 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:26.699694 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] [2b1986a3-a4e2-4c52-8820-5a4c9f1d1b96] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 53266. Aug 17 20:37:26.745842 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-a4e16542-d877-4bdc-8d8c-15ab7cac5cbe req-03764887-eea1-4008-91de-8ece1c2d8764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8873261-5f52-47b2-9346-b1d84ab01fea", "name": "network-vif-deleted", "tag": "c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:37:26.749497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:26.756161 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-a4e16542-d877-4bdc-8d8c-15ab7cac5cbe req-03764887-eea1-4008-91de-8ece1c2d8764 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:26.756651 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-a4e16542-d877-4bdc-8d8c-15ab7cac5cbe req-03764887-eea1-4008-91de-8ece1c2d8764 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:26.757083 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-a4e16542-d877-4bdc-8d8c-15ab7cac5cbe req-03764887-eea1-4008-91de-8ece1c2d8764 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:26.757255 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-43af5050-dce8-4d57-8649-177f70d950fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1390 microversion: 2.1 time: 0.093549 Aug 17 20:37:26.758125 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 621/1243] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:26 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:26.773655 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-a4e16542-d877-4bdc-8d8c-15ab7cac5cbe req-03764887-eea1-4008-91de-8ece1c2d8764 service nova] Creating event network-vif-deleted:c57b4d58-81b4-47a5-8dc7-c4f2b5ba46f8 for instance c8873261-5f52-47b2-9346-b1d84ab01fea on hv-cinder-83538 Aug 17 20:37:26.778994 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-a4e16542-d877-4bdc-8d8c-15ab7cac5cbe req-03764887-eea1-4008-91de-8ece1c2d8764 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116443 Aug 17 20:37:26.779581 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 623/1244] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:37:27.778883 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:27.779512 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:27.786090 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:27.786574 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:27.787043 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:27.787754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:27.788213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:27.788640 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:27.820704 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:27.821186 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:27.821621 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:27.822066 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.objects.instance [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lazy-loading 'fault' on Instance uuid c8873261-5f52-47b2-9346-b1d84ab01fea {{(pid=121276) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:37:27.863496 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:27.871052 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-8a857eb1-fb5d-447a-a2b8-fcae5e03acb0 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 200 len: 1230 microversion: 2.1 time: 0.096252 Aug 17 20:37:27.871645 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 622/1245] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:27 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 1230 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:28.894506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:28.895224 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: c8873261-5f52-47b2-9346-b1d84ab01fea] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:28.901355 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:28.901831 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:28.902259 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:28.902970 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:28.904352 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:28.904931 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:28.917781 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] HTTP exception thrown: Instance c8873261-5f52-47b2-9346-b1d84ab01fea could not be found. Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Request method failure captured: Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea HTTP/1.1 Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-9JD3XkNiVD8yy0wMGStnfE-r2w3oly2Yut6DXz4EuV5MgyS_VD-ciK7m-epFqFng3Yt8uOS1Fiy5zFxc0bAIYw850jFA-8JpPqFeKfOQPj-gDvH3n8nduVVTkdJjbkJWFSwoM2Y6zbKOnsgfDKEuQHPnG6q006XdqOipGWv6X1kU Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:37:28.919752 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 79b37b77e3e44797b58ef9dd89747ca4 Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance c8873261-5f52-47b2-9346-b1d84ab01fea could not be found. Aug 17 20:37:28.921528 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': 'c8873261-5f52-47b2-9346-b1d84ab01fea'} Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8873261-5f52-47b2-9346-b1d84ab01fea could not be found. Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:37:28.922484 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8873261-5f52-47b2-9346-b1d84ab01fea could not be found. Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8873261-5f52-47b2-9346-b1d84ab01fea could not be found. Aug 17 20:37:28.924196 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:28.925918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Returning 404 to user: Instance c8873261-5f52-47b2-9346-b1d84ab01fea could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:37:28.925918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-2da5a0fd-95df-4179-b3e5-95a75f2ca7f4 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea" status: 404 len: 111 microversion: 2.1 time: 0.031371 Aug 17 20:37:28.925918 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 624/1246] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:28 2022] GET /compute/v2.1/servers/c8873261-5f52-47b2-9346-b1d84ab01fea => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:37:32.306524 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [req-e02267e6-975d-4d91-9ace-41f389d22191 req-cd6a5bc0-051d-4f88-b6cc-c0e4f78b6252 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab796b32-939e-41bb-8676-0bec10b2aa93", "tag": "956cf680-0d63-4294-b14a-3d2f42b56109"}]} {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:37:32.314711 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:32.315238 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:32.321837 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:32.322340 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:32.322897 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:32.323720 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:32.324183 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:32.324366 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e02267e6-975d-4d91-9ace-41f389d22191 req-cd6a5bc0-051d-4f88-b6cc-c0e4f78b6252 service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:32.324770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:32.325058 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e02267e6-975d-4d91-9ace-41f389d22191 req-cd6a5bc0-051d-4f88-b6cc-c0e4f78b6252 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:32.325494 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [req-e02267e6-975d-4d91-9ace-41f389d22191 req-cd6a5bc0-051d-4f88-b6cc-c0e4f78b6252 service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:32.337774 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.compute.server_external_events [req-e02267e6-975d-4d91-9ace-41f389d22191 req-cd6a5bc0-051d-4f88-b6cc-c0e4f78b6252 service nova] Creating event network-changed:956cf680-0d63-4294-b14a-3d2f42b56109 for instance ab796b32-939e-41bb-8676-0bec10b2aa93 on hv-cinder-83538 Aug 17 20:37:32.343106 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [req-e02267e6-975d-4d91-9ace-41f389d22191 req-cd6a5bc0-051d-4f88-b6cc-c0e4f78b6252 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040190 Aug 17 20:37:32.343939 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 625/1247] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:37:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:37:32.357118 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Going to try to terminate instance {{(pid=121276) delete /opt/stack/nova/nova/compute/api.py:2666}} Aug 17 20:37:32.805459 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-4722dd05-447f-4fd3-94ee-bd1a1a9b5c9e tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 204 len: 0 microversion: 2.1 time: 0.504988 Aug 17 20:37:32.806082 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 623/1248] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:37:32 2022] DELETE /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 17 20:37:32.819871 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:32.820578 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:32.827415 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:32.827954 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:32.828399 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:32.829096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:32.829549 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:32.829993 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:32.968421 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:32.976029 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-ba86ae49-6a37-4385-a46a-b1611f98a2fc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1577 microversion: 2.1 time: 0.165274 Aug 17 20:37:32.976594 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 626/1249] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:32 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:34.000033 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:34.000648 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:34.007246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:34.007766 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:34.008204 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:34.008903 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:34.009359 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:34.009786 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:34.142699 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.policy [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121276) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:34.150213 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-bdae5b56-2528-4b88-8e59-a95faefa5ec3 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1577 microversion: 2.1 time: 0.155269 Aug 17 20:37:34.150813 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 624/1250] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:33 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:35.171854 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:35.172455 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:35.179020 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:35.179506 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:35.179942 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:35.180641 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:35.181096 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:35.181516 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:35.318320 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:35.331592 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-59602a1f-e07c-4db2-adb7-3cde216e038d tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1458 microversion: 2.1 time: 0.163735 Aug 17 20:37:35.333307 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 627/1251] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:35 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1458 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:35.385431 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [req-441a435a-964f-4572-b89b-ccba9e36cd2e req-b0323fa0-d30a-4c52-8732-2a3af6aae01e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab796b32-939e-41bb-8676-0bec10b2aa93", "name": "network-vif-deleted", "tag": "956cf680-0d63-4294-b14a-3d2f42b56109"}]} {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 17 20:37:35.395801 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-441a435a-964f-4572-b89b-ccba9e36cd2e req-b0323fa0-d30a-4c52-8732-2a3af6aae01e service nova] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:35.396277 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-441a435a-964f-4572-b89b-ccba9e36cd2e req-b0323fa0-d30a-4c52-8732-2a3af6aae01e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:35.396701 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [req-441a435a-964f-4572-b89b-ccba9e36cd2e req-b0323fa0-d30a-4c52-8732-2a3af6aae01e service nova] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:35.408208 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.compute.server_external_events [req-441a435a-964f-4572-b89b-ccba9e36cd2e req-b0323fa0-d30a-4c52-8732-2a3af6aae01e service nova] Creating event network-vif-deleted:956cf680-0d63-4294-b14a-3d2f42b56109 for instance ab796b32-939e-41bb-8676-0bec10b2aa93 on hv-cinder-83538 Aug 17 20:37:35.413153 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [req-441a435a-964f-4572-b89b-ccba9e36cd2e req-b0323fa0-d30a-4c52-8732-2a3af6aae01e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031379 Aug 17 20:37:35.413730 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 625/1252] 10.222.0.64 () {64 vars in 1317 bytes} [Wed Aug 17 20:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 17 20:37:36.354152 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:36.354843 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:36.361709 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:36.362475 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:36.362909 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:36.363683 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:36.364136 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:36.364560 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:36.400170 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:36.400644 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:36.401073 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:36.401509 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.objects.instance [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lazy-loading 'fault' on Instance uuid ab796b32-939e-41bb-8676-0bec10b2aa93 {{(pid=121275) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 17 20:37:36.445278 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.policy [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79b37b77e3e44797b58ef9dd89747ca4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '62ed5118006d48e8a68f1f4506e54546', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121275) authorize /opt/stack/nova/nova/policy.py:199}} Aug 17 20:37:36.453860 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-a0cd2022-5bed-47a5-b27b-67bcd22414bf tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 200 len: 1230 microversion: 2.1 time: 0.103683 Aug 17 20:37:36.454424 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 628/1253] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:36 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 1230 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 17 20:37:37.475683 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:37.476383 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: ab796b32-939e-41bb-8676-0bec10b2aa93] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:37.482517 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:37.483770 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:37.484346 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:37.485041 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:37.485497 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:37.485922 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:37.499410 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] HTTP exception thrown: Instance ab796b32-939e-41bb-8676-0bec10b2aa93 could not be found. Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Request method failure captured: Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 HTTP/1.1 Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-9JD3XkNiVD8yy0wMGStnfE-r2w3oly2Yut6DXz4EuV5MgyS_VD-ciK7m-epFqFng3Yt8uOS1Fiy5zFxc0bAIYw850jFA-8JpPqFeKfOQPj-gDvH3n8nduVVTkdJjbkJWFSwoM2Y6zbKOnsgfDKEuQHPnG6q006XdqOipGWv6X1kU Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:37:37.501022 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 79b37b77e3e44797b58ef9dd89747ca4 Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance ab796b32-939e-41bb-8676-0bec10b2aa93 could not be found. Aug 17 20:37:37.502532 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': 'ab796b32-939e-41bb-8676-0bec10b2aa93'} Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab796b32-939e-41bb-8676-0bec10b2aa93 could not be found. Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:37:37.503445 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab796b32-939e-41bb-8676-0bec10b2aa93 could not be found. Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab796b32-939e-41bb-8676-0bec10b2aa93 could not be found. Aug 17 20:37:37.505182 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:37.506843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Returning 404 to user: Instance ab796b32-939e-41bb-8676-0bec10b2aa93 could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:37:37.506843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-3b25b350-46b0-402c-88d4-da8d2dc72d20 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93" status: 404 len: 111 microversion: 2.1 time: 0.031584 Aug 17 20:37:37.506843 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 626/1254] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:37 2022] GET /compute/v2.1/servers/ab796b32-939e-41bb-8676-0bec10b2aa93 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:37:38.078997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:38.079577 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.compute.api [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121275) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:38.086048 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:38.086448 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:38.086979 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:38.087678 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:38.088135 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:38.088680 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG oslo_concurrency.lockutils [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121275) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:38.103181 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.wsgi [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] HTTP exception thrown: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Request method failure captured: Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: request: DELETE /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab HTTP/1.1 Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept: application/json Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Accept-Encoding: identity Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Connection: close Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Length: 0 Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Content-Type: application/json Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Host: 10.222.0.64 Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Openstack-System-Scope: None Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: User-Agent: python-urllib3/1.26.11 Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Auth-Token: gAAAAABi_U-9JD3XkNiVD8yy0wMGStnfE-r2w3oly2Yut6DXz4EuV5MgyS_VD-ciK7m-epFqFng3Yt8uOS1Fiy5zFxc0bAIYw850jFA-8JpPqFeKfOQPj-gDvH3n8nduVVTkdJjbkJWFSwoM2Y6zbKOnsgfDKEuQHPnG6q006XdqOipGWv6X1kU Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Id: None Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Domain-Name: None Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Identity-Status: Confirmed Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Is-Admin-Project: True Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Id: default Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Domain-Name: Default Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Project-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Role: member,reader Aug 17 20:37:38.110564 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Roles: member,reader Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-Tenant-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Id: default Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Domain-Name: Default Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Id: 79b37b77e3e44797b58ef9dd89747ca4 Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: X-User-Name: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: method: > Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: exception: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.112458 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: action_args: {'id': '55ca97cd-ad46-405d-8cfb-dc734e6523ab'} Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:37:38.113301 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.114601 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.115997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Returning 404 to user: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. {{(pid=121275) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:37:38.115997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-5da6688d-1b11-4831-848e-f4ebc9d01dbc tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "DELETE /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 404 len: 111 microversion: 2.1 time: 0.031838 Aug 17 20:37:38.115997 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 629/1255] 10.222.0.64 () {58 vars in 1239 bytes} [Wed Aug 17 20:37:38 2022] DELETE /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:37:38.118136 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '>' {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:38.118808 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.compute.api [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [instance: 55ca97cd-ad46-405d-8cfb-dc734e6523ab] Fetching instance by UUID {{(pid=121276) get /opt/stack/nova/nova/compute/api.py:2922}} Aug 17 20:37:38.125120 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:38.125607 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:38.126046 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:38.126766 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Acquiring lock "eb200869-c0cd-497b-a077-1c09d01e21d1" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 17 20:37:38.127225 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 17 20:37:38.127651 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG oslo_concurrency.lockutils [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Lock "eb200869-c0cd-497b-a077-1c09d01e21d1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121276) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 17 20:37:38.142016 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.wsgi [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] HTTP exception thrown: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Request method failure captured: Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: request: GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab HTTP/1.1 Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept: application/json Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Accept-Encoding: identity Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Connection: close Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Length: 0 Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Content-Type: application/json Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Host: 10.222.0.64 Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Openstack-System-Scope: None Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: User-Agent: python-urllib3/1.26.11 Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Auth-Token: gAAAAABi_U-9JD3XkNiVD8yy0wMGStnfE-r2w3oly2Yut6DXz4EuV5MgyS_VD-ciK7m-epFqFng3Yt8uOS1Fiy5zFxc0bAIYw850jFA-8JpPqFeKfOQPj-gDvH3n8nduVVTkdJjbkJWFSwoM2Y6zbKOnsgfDKEuQHPnG6q006XdqOipGWv6X1kU Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Id: None Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Domain-Name: None Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Identity-Status: Confirmed Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Is-Admin-Project: True Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Id: default Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Domain-Name: Default Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Project-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Role: member,reader Aug 17 20:37:38.143565 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Roles: member,reader Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/networking"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.64:8080", "publicURL": "http://10.222.0.64:8080/v1/AUTH_62ed5118006d48e8a68f1f4506e54546"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}] Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Id: 62ed5118006d48e8a68f1f4506e54546 Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-Tenant-Name: tempest-TestVolumeBootPattern-837355310 Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Id: default Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Domain-Name: Default Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Id: 79b37b77e3e44797b58ef9dd89747ca4 Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: X-User-Name: tempest-TestVolumeBootPattern-837355310-project Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: method: > Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: exception: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.145285 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: action_args: {'id': '55ca97cd-ad46-405d-8cfb-dc734e6523ab'} Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: {{(pid=121276) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in get Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2872, in _get_instance Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2829, in _get_instance_from_cell Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 17 20:37:38.146246 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. Aug 17 20:37:38.147578 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: ERROR nova.api.openstack.wsgi Aug 17 20:37:38.148754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: DEBUG nova.api.openstack.wsgi [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Returning 404 to user: Instance 55ca97cd-ad46-405d-8cfb-dc734e6523ab could not be found. {{(pid=121276) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 17 20:37:38.148754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO nova.api.openstack.requestlog [None req-ae24f14f-80eb-4a36-8cfa-dc0604de90c9 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab" status: 404 len: 111 microversion: 2.1 time: 0.030817 Aug 17 20:37:38.148754 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: [pid: 121276|app: 0|req: 627/1256] 10.222.0.64 () {58 vars in 1236 bytes} [Wed Aug 17 20:37:38 2022] GET /compute/v2.1/servers/55ca97cd-ad46-405d-8cfb-dc734e6523ab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 17 20:37:39.800138 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: DEBUG nova.api.openstack.wsgi [None req-dae1ef71-c88a-4ef7-a4ea-f80f097d0e06 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] Calling method '.version_select at 0x7f23e1de7e50>' {{(pid=121275) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 17 20:37:39.804602 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: ERROR oslo.messaging._drivers.impl_rabbit [None req-dae1ef71-c88a-4ef7-a4ea-f80f097d0e06 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [dc02823d-c4e6-4d72-a99b-ebbf5c5f555e] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 17 20:37:40.812877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [None req-dae1ef71-c88a-4ef7-a4ea-f80f097d0e06 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] [dc02823d-c4e6-4d72-a99b-ebbf5c5f555e] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 53320. Aug 17 20:37:40.910190 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO nova.api.openstack.requestlog [None req-dae1ef71-c88a-4ef7-a4ea-f80f097d0e06 tempest-TestVolumeBootPattern-837355310 tempest-TestVolumeBootPattern-837355310-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-256203961" status: 202 len: 0 microversion: 2.1 time: 1.114774 Aug 17 20:37:40.910807 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: [pid: 121275|app: 0|req: 630/1257] 10.222.0.64 () {58 vars in 1260 bytes} [Wed Aug 17 20:37:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-256203961 => generated 0 bytes in 1116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 17 20:38:07.287487 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:38:07.288135 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Wed Aug 17 20:38:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:38:24.778877 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:38:24.779419 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Wed Aug 17 20:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:39:53.157007 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:39:53.157629 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Wed Aug 17 20:39:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:40:07.913001 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:40:07.913639 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Wed Aug 17 20:40:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:40:08.165881 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:40:08.166473 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Wed Aug 17 20:40:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:41:27.296707 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:41:27.297433 dv-cinder-835384-19-iscsi devstack@n-api.service[121276]: Wed Aug 17 20:41:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 17 20:41:44.787478 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 17 20:41:44.788249 dv-cinder-835384-19-iscsi devstack@n-api.service[121275]: Wed Aug 17 20:41:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!